«F" 


Tcchiical  Rtstarcii  Report  1134 


PREDICTION  OF  OFFICER  PERFORMANCE 


Best  Available  Copy 


U.  S.  ARMY  PERSONNEL  RESEARCH  OFFICE 


An  activity  of  the  Chief,  Research  and  Development 


Charles  S.  Getsoni 
Colonel,  GS 
Commanding 


J.  E.  Uhlaner 

Director,  Resecvch  Laboratories 


Hubert  E.  Brogden 
Chief  Scientist 


initio!  distribution  el  this  resort  hot  neon  mode  by  the  U.  S.  Army  Personnel  Research  Office 
Additional  cosies  mey  be  ebteined  es  fellows.  Deyertment  of  Defense  agencies  and  their  con¬ 
tractors  should  address  reaeeots  for  eddltienel  copies  to:  Director,  Defense  Documentation 
Center,  ATTN:  TIOC,  Bldg.  No.  5,  Cameron  Station,  Atsaendrle,  Virginia,  22314.  Other  agencies 
end  sorsens  mey  obtain  information  on  cast  el  microfilm  or  photostetic  copies  from:  Office  of 
Technical  Services,  Department  el  Commerce,  Washington,  D.  C.  20230,  ATTN:  Technical 
Resorts  Section.  Cosies  mey  else  be  ebteined  en  lean  from  local  depository  libraries.  A  list 
el  these  libraries  mey  be  ebteined  from:  Documents  Eapediting  Project,  Library  of  Congress, 
Washington,  D.  C.  20S40.  The  moiling  address  ef  IISAPRO  Is:  U.  S,  Army  Personnel  Research 
Office,  Washington,  D.  C.  20315. 


Tackalcal  tasaarck  Kaport  1134 


PREDICTION  OF  OFFICER  PERFORMANCE 


Louis  P.  Willemin 


Submitted  by  Leonard  V.  Gordon 

Chief,  Behavioral  Evaluation  Research  Laboratory 


Approved  by 


Director,  Research  Laboratories 


Hubert  E.  Brogden 
Chief  Scientist 

Charles  S.  Gersoni 
Colonel,  GS 
Commanding 


Army  Project  Number 
2J024701A722 


Officer  Prediction  Tosk, 


March  1964 


USAPRO  Technical  Resaarch  Reports  and  Technical  Rasearch  Notes  are  intended 
for  sponsors  of  R&D  tasks  and  other  rasearch  and  military  ogencies.  Any  findings 
ready  for  implementation  at  the  time  of  publication  are  presented  in  the  latter  part 
of  the  Brief.  Upon  completion  of  a  major  phase  of  the  task,  formal  recommenda¬ 
tions  for  official  action  normally  are  conveyed  to  appropriate  military  agencies  by 
briefing  or  Disposition  Form. 


PREDICTION  OF  OFFICER  PERFORMANCE 


I 


BRIEF 


Requirement: 

To  develop  improved  techniques  and  prerequisites  for  identifying  officers  who  have  aptitudes  and 
other  characteristics  to  meet  the  demands  for  successful  performance  in  different  types  of  officer  command 
responsibility. 


Procedure: 

By  field  observation  and  analysis  of  officer  MOS,  the  current  study  was  centered  on  prediction  of 
ability  to  meet  the  psychological  requirements  of  three  types  of  officer  assignment-technical,  admimstra- 
five,  and  combat.  The  research  program  consists  in  essence  of  the  construction  of  a  battery  of  experi¬ 
mental  tests-the  Differential  Officer  Battery  (DOB)--ond  the  determination  of  the  effectiveness  of  these 
tests  in  differentially  predicting  officer  performance  In  the  three  areas  of  activity.  The  experimental  pre¬ 
dictors  ha  ve  been  developed  through  a  process  of  shortening  and  refinement,  in  which  o  preliminary 
battery  was  administered  to  6500  officers  and  effectiveness  of  battery  components  was  determined  by 
analysis  of  responses  of  groups  of  officers  representative  of  the  three  fields  of  assignment.  A  series  of 
situational  tests  in  which  the  officer  is  confronted  w  th  problems  typical  of  service  in  each  of  three  areas 
was  developed  to  provide  the  measure  of  officer  performance  against  which  the  tests  are  being  validated. 
Analysis  of  the  relationship  between  the  shortened  experimental  bottery  and  criterion  performance  test 
scores  will  be  the  final  test  of  efforts  to  predict  officer  performance  differentially  according  to  type  of 
duty  assignment. 


Current  Status  of  the  Research  Program: 

Validation  of  the  DOB  is  in  progress.  Experimental  tests  comprising  the  battery  were  administered 
in  1961-1962  to  3500  officers  entering  on  active  duty.  Current  octivity  centers  on  obtaining  situational 
performance  measures  of  officer  effectiveness  for  900  of  these  officers-300  who  have  served  in  technical 
assignments,  300  in  administrative,  and  300  in  combat. 

The  Officer  Evaluation  Center  (OEf)  was  established  at  Fort  McClellan  as  headquarters  for  perform¬ 
ance  evaluation  of  the  officers  constituting  the  validation  sample.  The  situational  tests-five  technical, 
five  administrative,  and  five  combat-have  been  integrated  info  a  continuous  test  exercise  administered  at 
the  OEC  in  a  simulated  MAAG  setting.  OEC  testing  has  progressed  through  shakedown  operation  to 
regularly  scheduled  testing  of  three  six-mon  groups  in  eoch  two-week  period. 

Job  data  and  on-the-job  ratings  obtained  oil  successive  waves  of  DOB  exominees  provide  the  basis  for 
continuing  selection  of  officers  to  report  to  the  Center  for  situational  testing. 


Initial  statistical  processing  of  situational  test  data  and  auxiliary  criterion  dota-branch  and  job 
satisfaction  and  intention  to  remain  in  the  service— has  begun  on  a  small  scale.  The  first  differential 
validity  analysis  will  be  undertaken  in  1964-1965  when  criterion  coses  in  sufficient  numbers  hove  bet  - 
processed  through  the  Center.  Further  analysis  will  be  conducted  sequentially  thereafter  as  data  are 
accumulated  on  sufficient  numbers  of  officers. 

Utilization  of  Findings: 

New  personnel  management  tools  developed  through  this  program,  together  with  increased  underst-- 
ing  of  the  differing  psychological  requirements  of  different  kinds  of  officer  jobs,  will  permit  greater  .r 
crimination  in  the  assignment  of  officers,  particularly  newly  commissioned  ROTC  graduates  serving 
year  obligated  term  of  service.  Such  improvement  in  officer  assignment  should  lead  to  heightened  care 
satisfaction  on  the  part  of  officers  and,  ultimately,  to  greater  military  effectiveness. 
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PREDICTION  OF  OFFICER  PERFORMANCE 


OVERVIEW 


Over  the  years,  selection  of  officers  has  reflected  considerations 
of  generalized  officer  potential  in  terms  of  mental  ability  and  personal 
characteristics.  Progressive  assignment  of  career  officers  also  has  to 
a  considerable  extent  reflected  the  "generalist"  concept,  according  to 
which  an  officer  is  broadly  trained  and  capable  of  serving  effectively 
in  a  vide  range  of  duty  assignments.  More  recently,  accelerated  progress 
in  military  technology  has  brought  about  increasing  diversity  and  com* 
plexity  in  individual  officer  jobs.  In  a  modern  army,  many  officer 
assignments  require  specialized  capabilities,  particularly  in  those 
responsible  for  operation  and  tactical  employment  of  the  Army's  modern 
■weapons  ani  communications  systems. 


These  changes  in  the  nature  of  the  commissioned  function  have  led 
to  modifications  in  the  ’•generalist"  concept,  and  have  raised  questions 
about  the  extent  to  which  abilities  to  meet  the  differing  psychological 
demands  of  officer  Jobs  vary  with  individual  officers.  Assuming  that 
officers  differ  in  their  potential  for  responsibility  in  different  fields 
of  Army  activity,  how  successfully  can  these  differing  potentials  be 
predicted  by  psychological  measures  suitable  for  operational  use 1 

Concern  over  these  questions  generated  a  DCSFER  requirement  for  new 
personnel  management  tools  which  will  provide  means  by  which  more  dis¬ 
criminating  assignment  of  officers  can  be  made  and  which  will  lead 
to  improved  overall  officer  performance.  Such  tools  are  particularly 
needed  to  guide  the  Initial  assignment  of  newly  commissioned  second 
lieutenants,  many  of  wham  are  ROTC  graduates  serving  a  two-year  obligated 
tour,  after  which  they  expect  to  return  to  civilian  life.  Most  HOTC 
graduates  have  had  General  Military  Science  training  in  the  colleges, 
and  their  specialized  training  occurs  only  After  their  entry  into  service. 

The  Officer  Prediction  Task  was  established  within  the  U.  3.  Army 
Personnel  Research  Office  (U3AFR0)  to  provide  the  Army  vith  Improved 
techniques  and  prerequisites  for  selecting  officers  who  have  aptitudes 
and  other  characteristics  to  aeet  the  differing  demands  of  successful 
performance  in  different  kinds  of  assignment. 


Research  Approach 

Research  conducted  prior  to  the  inception  of  the  Officer  Prediction 
Task  had  shown  considerable  success  in  the  development  and  use  of  tests 
to  select  individuals  who  would  successfully  complete  officer  training 
and  perform  well  in  military  assignments.  Selection  programs  for  the 


U.  S.  Military  Acadeny,  the  Command  and  General  Staff  College,  Officer 
Candidate  School,  and  Reserve  Officer  Trainiitg  Corps  give  evidence  of 
the  technical  promise  of  research  to  identify  special  facets  of  Job 
coiapetence  and  special  abilities  peculiar  to  high  level  Job3  and  to 
develop  from  these  findings  valid  predictors  of  successful  performance. 

In  a  strict  sense,  no  two  officer  jobs  are  exactly  alike.  But  it 
would  be  manifestly  impossible  to  seek  differential  prediction  of  effec¬ 
tiveness  in  the  400  Military  Occupational  Specialties  (MOB)  into  vhich 
the  jobs  fall.  AERO  research  scientists  did,  in  fact,  select  u  limited 
number  of  job  types  for  analysis  to  determine  whether  efficiency  ratings 
could  be  used  to  demarcate  Job  clusters  which  would  serve  as  a  basis  for 
studies  of  differential  prediction.  The  efficiency  ratings  of  10,000 
officers  were  analyzed,  but  the  evaluations  failed  to  reflect  difference 
in  performance  across  the  selected  types  of  assignment. 

After  extensive  examination  of  Job  descriptions  for  the  Army's 
officer  slots,  three  broad  areas  of  duty  assignment --technical,  adminis¬ 
trative,  and  combat --were  selected  as  the  basis  for  initial  research 
planning.  These  three  areas  appeared  to  differ  maximally  in  psycholu 
requirements  and  to  offer  a  basis  for  testing  an  initial  minimum  hypoth: 
sis  as  to  the  differential  predictability  of  officer  performance.  At  th 
same  time,  the  three  areas,  while  not  all-inclusive  of  officer  jobs, 
subsume  large  numbers  of  officer  assignments. 

The  research  requirement  is,  first,  to  determine  whether  ability  tc 
meet  the  differing  psychological  demands  of  technical,  administrative  d  , 
combat  officer  jobs  is  predictable,  and,  if  so,  to  provide  psychological 
instruments  to  assess— preferably  before  conDissioning--the  ability  of 
Individ ‘is Is  to  meet  these  differing  demands.  In  brief,  the  research 
program  includes  the  following  steps: 

1.  Development  of  psychological  measures  designed  to  be  differ¬ 
entially  predictive  of  performance  in  technical,  administrative,  and 
combat  assignments,  and  administration  of  the  experimental  measures  to 
an  officer  input  sample. 

2.  Development  of  eituational  criterion  measures  reflecting  actual 
performance  in  technical,  administrative,  and  combat-type  duties,  and 
administration  of  these  tests  to  officers  previously  tested  with  the 
experimental  predictors. 

5*  Validity  analysis  of  the  relationships  among  the  several  pre¬ 
dictor  end  criterion  measures  to  test  the  minimum  hypothesis  that 
abilities  to  meet  the  differing  psychological  requirements  of  technical, 
admini8tiatlve,  and  combat  officer  JobB  are  differentially  predictable. 

4.  Identification  of  predictor  measures  which  the  Army  can  use 
operationally  to  assess  the  relative  potential  of  newly  c omnia atoned 
officers  in  the  three  broad  areas  of  officer  assignments. 


With  respect  to  the  criterion  problem,  several  considerations  led 
to  the  decision  that  situational  performance  tests,  incorporating  techni¬ 
cal,  administrative,  and  combat-type  duties,  should  be  the  primary 
criterion  of  the  validity  of  the  new  tests  as  differential  predictors. 

A  cogent  reason  for  the  decision  was  that  measures  of  performance  in  all 
three  Job  areas  were  needed  for  each  examinee.  On-the-job  ratings  could 
be  obtained  only  for  the  job  area  in  which  the  rated  officer  was  actually 
serving.  Additionally,  the  situational  criterion  measures  based  on 
standardized  observation  procedures  could  be  based  on  uniform  problems 
for  all  examinees. 

The  situational  criterion  had  the  strong  indorsement  of  the  Human 
Factors  oub panel  of  the  Army  Scientific  Advisory  Panel.  The  Subpanel 
favored  the  performance  tests  over  ratings  as  being  more  compatible  with 
the  requirement  for  development  of  measures  to  predict  competence  in 
combat  officer  assignments.  The  situational  criterion  offered  at  least 
the  possibility  of  simulating  some  of  the  stresses  of  wartime  operations. 

Criterion  specifications  clearly  placed  unusually  heavy  demands 
both  on  the  research  task  for  criterion  construction  and  on  the  Army  for 
administrative  and  logistic  support.  Officer  Evaluation  Centers— at 
first  three  were  planned— were  projected  to  serve  as  headquarters  and 
field  setting  for  the  situational  tests.  Eventually,  the  requirement 
was  reduced  to  a  single  center.  3he  CEC  at  Fort  McClellan  (Figure  1) 
was  activated  in  1962  with  the  unique  mission  of  providing  criterion 
evaluations  of  performance  of  the  officers  comprising  the  sample  in 
which  the  experimental  tests  are  being  validated. 

During  FY  1965,  personnel  of  tbs  Officer  Evaluation  Center  were 
trained  In  administration  of  the  situational  performance  tests  con¬ 
structed  and  developed  through  field  tryout.  The  15  test  situations 
representative  of  combat,  administrative,  and  technical  officer  Jobs 
were  integrated  into  a  coherent  aequenee.  Revisions  and  additions  were 
made  on  the  basis  of  trial  administration  at  tbs  oeater.  The  first 
sample  of  officers  started  reporting  to  tbs  OK  in  February  1963. 

Through  June  1963,  officers  previously  tested  with  tbs  DOB  provided 
cases  for  shakedown  operation  of  tbe  Center.  Criterion  testing  began 
in  July  1963  and  la  expected  to  continue  through  June  1965. 


THf  EXPERIMENTAL  PREDICTOR  gATTERY 

The  predictor  battery  currently  being  validated  against  a  situa¬ 
tional  performance  criterion  resulted  frem  the  following  research  steps: 

1.  Initial  selectior.  of  types  of  instrument  end  content  areas  to 
be  Included  as  experiments  measures.  Officer  M06  descriptions  were 
studied  to  detenslne  tbs  psychological  requirements  of  various  Jobs  and 
the  characteristic  behaviors  involved.  Relevant  research  literature 
originating  both  within  and  outside  the  U.  S.  Army  was  surveyed  to 
formulate  rationales  for  the  experimental  predictor  content.  Since 
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Figure  1.  Heodquorters  building  of  the  Officer  Evaluotior 
previously  tested  with  the  experimental  Differ* 


personnel  about  to  be  commissioned  have  already  been  screened  on  general 
mental  ability  and  generalized  leadership  potential,  noncognitive  types 
of  predictor  material  vere  given  preference. 

2.  Test  construction,  including  development  ;■*  teot  items  and 
problems  and  firming  up  of  content  through  reviews  ana  informal  tryout. 

5-  Selection  of  battery  content  and  shortening  of  component  tests 
by  analysis  of  results  in  a  large  sample  of  officers. 

Samples  in  -which  battery  content  was  evaluated  were  selected  from 
approximately  6pG0  officers  to  whom  the  battery  in  original  three -jay 
form  vas  administered  during  iyyi-1'ffj.  Sad  an  Officer  Evalu: tier 
Center  been  operational  by  Vfjj  as  originally  planned,  the  experimental 
battery  would  have  been  validated  against  the  situational  performance 
criterion.  However,  when  the  estadishment  of  the  OEC  vas  delayed, 
decision  vas  made  to  obtain  special  on-the-job  ratings  of  the  officers 
in  the  sample  and  to  use  these  ratings  as  a  yardstick  against  which  to 
make  a  preliminary  evaluation  of  battery  components  and  item  content  of 
the  instruments.  Results  were  used  as  a  basis  for  eliminating  the  less 
effective  portions  of  the  battery.  (Details  of  the  data  processing  and 
analysis  are  presented  in  Section  I  of  the  technical  supplement.) 

By  July  1961,  the  entire  predictor  battery,  shortened  and  printed 
as  the  Differential  Officer  Battery  (DOB),  was  ready  for  administration 
to  a  new  sample  of  officers  entering  active  duty,  and  for  validation 
against  situational  criteria  administered  at  an  Officer  Evaluation 
Center.  The  shortened  DCS  requires  two  days  for  the  paper-and-pencil 
tests,  plus  about  one  hour  for  the  Physical  Skills  and  Stamina  Tests, 
and  another  hour  for  the  Officer  Potential  Ratings  which  are  obtained 
in  the  seventh  week  of  the  officer  Orientation  Course  instruction  at 
each  branch  school. 


Content  of  Bottory 

Six  types  of  predictor  have  been  retained  in  the  battery  now  under¬ 
going  validation  (Figure  2): 

1.  Biographical  and  Self -Description  Inatruments.  The  three 
instruments  included  measure  background,  personality  characteristics , 
attitudes,  and  expressed  interests. 

2.  Information  Teats.  Explicitly,  these  instruments  test  informa¬ 
tion  in  various  subject-matter  areas.  The  hypothesis  is  that  information 
gained,  particularly  without  formal  training  in  a  subject,  reflects 
interest  in  that  area.  Information  items  have  proved  differentially 
predictive  in  the  enlisted  domain  and  in  other  research  both  in  and  out 
of  the  Army.  Both  information  specific  to  military  tactics,  logistics, 
and  finance,  and  general  information--chiefly  nonmilitary — are  included. 
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INSTRUMENT 

FT  NO. 

ITEMS 

TIME  I 

Biographical  or  Self -Description 

Personal  Data  Record  (FDR) 

3397 

55 

50m in  1 

Differential  Inventory,  Bklt  A  (DI-A) 

4152 

212 

Ih  OOmin 

Differential  Inventory,  Bklt  B  (DI-B) 

4153 

330 

Ih  50min 

Information 

Information  Test,  Bklt  A  (IT-A) 

4148 

150 

Ih  15min  1 

Information  Test,  Bklt  B  (IT-B) 

4149 

150 

lh  15m in 

Information  Test,  Bklt  C  (IT-C) 

4150 

150 

lh  15min  j 

Information  Test,  Bklt  D  (H-D) 

4151 

150 

lh  15min  I 

Social  Perception 

Group  Awareness  Test  (GAT) 

4093 

75 

1 

t 

lh  OOmin  ! 

j 

Individual  Understanding  Test  (IUT) 

4092 

75*3 

lh  JOmin  1 
1 

t 

Cccxoand  Judgment 

Speeded  Practical  Jud^aent  Test  (SPJ) 

3395 

40 

lh  50min 

Physical  Skills  and  Staoina  (PS3) 

4079 

lh  OOmin 

Two -Band  Coordination  Vast 

(DA  6124) 

- 

- 

Kneeling  Basketball  Threw 

as 

- 

- 

faduranot  Crawl 

m 

- 

Officer  Potential  Ratings 

3381  (Rev) 

lh  OOmin 

■  lammai) — 

Job  A,  Administrative  Leadership 

3378 

as 

Job  B,  Tactical  and  Troop  leadership 

3379 

- 

•• 

Job  C,  Technical  Leadership 

3380 

- 

* 

Figure  2.  The  Differential  Officer  Battery  as  administered  te  officer  input,  June  1961-Februory  1963 
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3.  Social  Perception  Tests.  This  set  of  tests  is  designed  to 
measure  ability  to  estimate  opinions  of  others  in  a  group  (empathy)  or 
to  perceive  similarity  or  differences  in  the  vievs”and  attitudes  of 
individuals  (assumed  similarity).  Studies  have  shown  that  social  per¬ 
ception  of  this  type  is  related  to  leadership  and  tangentially  to  group 
effectiveness. 

k.  Command  Judgment.  The  Speeded  Practical  Judgment  Test  uses  a 
moving  picture  film  dramatizing  command  problems  to  measure  the  ability 
to  make  sound  leadership  decisions  in  situations  involving  subordinates. 
Speed  and  soundness  of  judgment  have  been  found  to  be  related  to  leader¬ 
ship  in  a  variety  of  situations. 

5.  Tests  of  Physical  Skills  and  Stamina.  Measures  of  physical 
proficiency  have  been  found  to  predict  leadership  ratings  of  U3MA.  cadets 
and  later  efficiency  ratings  and  Korean  combat  performance  of  U3MA. 
graduates,  as  well  as  performance  of  enlisted  men  in  Arctic  maneuvers. 

6.  Peer  Evaluations.  Early  ratings  by  associates  have  been  found 
to  predict  later  leadership  behavior  in  a  variety  of  situations  including 
ccoibat.  To  evaluate  peer  ratings  for  differential  prediction,  the 
ratings  were  obtained  after  the  officers  had  had  seven  weeks  of  associa¬ 
tion  during  initial  branch  training. 


THE  SITUATIONAL  CRITERION  TESTS 

The  framework  for  the  officer  testing  is  a  simulated  Military 
Assistance  Advisory  Group  (HAAG)  Headquarters.  The  MAAC  setting  appeared 
to  provide  a  reasonable  vehicle  for  introduction  of  a  variety  of  duty 
assignments.  Hone  of  the  tested  lieutenants  will  have  had  specific  MAAG 
experience;  thus  the  environment  is  equally  unfamiliar  to  all.  The 
lieutenants  to  be  given  the  situational  criterion  tests  ore  informed 
that  they  are  reporting  for  duty  at  a  United  States  Amy  MAAG  Headquarters 
located  on  the  outskirts  of  the  capital  city  of  a  friendly  host  nation. 
While  awaiting  reassignment  to  a  field  unit,  they  are  told  they  will  be 
called  upon  to  perform  a  nuatoer  of  different  assignments.  The  narrative 
provides  for  a  succession  of  technical  and  administrative  assignments, 
followed  by  appropriate  coobat  activity. 

The  basic  purpose  of  the  situational  tests  is  to  provide  measures 
of  performance  in  duties  representing  the  technical,  administrative,  and 
combat  Job  areas— measures  which  will  permit  differential  validation  of 
the  predictors  in  those  areas  as  a  test  of  the  minimum  hypothesis.  Tasks 
were  selected  to  provide  reliable  coverage  of  each  area,  but  the  whole 
spectrum  of  activities  in  each  area  was  not  necessarily  represented. 

Under  this  concept,  each  Job  sample  is  a  mission  or  specific  assign¬ 
ment  which  in  it3  totality  is  representative  primarily  of  one  of  the 
three  areas.  These  representative  missions,  or  job  samples,  are  inte¬ 
grated  into  a  single  exercise  bound  together  in  a  realistic  sequence. 


*  i  " 


Situational  T«*t  Requirements 


Certain  research  requirements  provided  joint  and  continuing  guidance 
throughout  the  development  oi  the  situational  measures: 

1.  Wince  all  criterion  examinees,  regardless  of  background,  vould 
be  measured  in  all  tasks,  it  was  necessary  that  all  tasks  be  susceptible 
of  performance  without  specialised  experience  and  training.  Officers 
having  the  specialized  experience  and  training  relevant  to  a  particular 
task  would,  of  course,  be  at  some  advantage j  but  the  briefings,  refer¬ 
ences,  and  other  resources  male  available  for  each  task  wools,  permit  all 
officers  to  undertake  each  particular  problem. 

2.  'Within  each  area  (technical,  administrative,  combat)  the  tasxs 
chosen  should  involve  military  activities  which  qualifies  military  con¬ 
sultants  recognize  as  military  requirements  representative  of  a  given 
area.  For  purposes  of  the  experiment,  and  particularly  in  view  of  the 
extreme  economy  required  in  support  personnel,  an  officer  being  examine . 
night  he  called  upon  at  times  to  perform  tasks  which  an  officer  would 
normally  have  someone  perform  for  him,  but  the  task  itself  should  be  a 
reasonable  military  requirement. 

3.  The  military  activities  called  for  in  the  various  tasks  should 
involve  psychological  behaviors  or  military  end-products  which  ur«_  mili¬ 
tarily  meaningful  and  characteristic  of  good  or  poor  officer  peifsrannoo 
in  the  given  setting.  That  is,  performance  should  be  recognizable  by 
qualified  military  consultants  as  acceptable  or  unacceptable,  capable  of 
being  observed,  and  capable  of  being  objectively  recorded  or  qualitatively 
evaluated. 


The  Scenarios  for  the  Individual  Test* 

In  preparing  tests  for  each  area,  the  first  step  was  to  consult  the 
appropriate  sources --officers  who  were  experts  in  their  particular  field, 
as  well  as  relevant  publications.  An  overall  outline  of  intended  t^nt 
coverage  of  each  area  was  then  sketched  out.  Short  statements  of  poten¬ 
tial  Job-3omple  teats  were  formulated  and  then  expanded  into  two-page 
test  auranarieo .  The  test  summaries  were  reviewed  by  subject-matter 
experts,  and  the  more  premising  were  selected  and  revised  for  further 
development.  For  each  sumaary  so  selected,  the  military -psychological 
factors  to  be  measured  were  identified.  In  consultation  v/ith  subject- 
matter  experts,  the  selected  test  summaries  were  expanded  into  draft 
scenarios  of  test  action. 


Compltting  the  Scenarios  in  th«  Field 

The  draft  scenarios  were  subjected  to  tryout  administration,  during 
which  further  development  and  revisions  were  accomplished.  This  phase 
was  completed  by  the  middle  of  1959  ♦  During  the  next  two  years,  the 


-  a  - 


scenario  for  each  test  was  incorporated  into  a  full  manual  which  Included 
complete  background.,  facilities,  personnel  and  time  requirements,  instruc¬ 
tions  for  administration,  and  all  scoring  documents  nueded  to  administer 
the  tests  either  as  a  single  problem  or  as  part  of  an  integrated  series 
of  problems. 

Each  situational  test  was  then  taken  to  the  appropriate  branch  school 
(Figure  3)  for  technical  review  by  subject-matter  experts  of  the  school 
faculty,  and  dry-run  administration.  Further  revisions  were  made  as 
necessary,  and  the  revised  manuals  were  reprinted  for  use  in  the  situa¬ 
tional  criterion  testing.  Final  refinements  in  each  test  were  worked  out 
during  initial  implementation  of  the  Differential  Officer  Performance 
Battery  (DOPB)  at  the  U.  S.  Army  Officer  Evaluation  Center. 


TECHNICAL  AND  . ’JMINISTRAT IVE  TEST3 


U.  3.  Array  Engineer  School 

U,  3.  Arm;’-  Ordnance  School 

U.  3.  Array  Quartermaster  School 

U.  3.  Array  Signal  School 

U.  3.  Array  Transportation  School 

The  Adjutant  General's  School, 

U.  3.  Array 


Fort  Belvoir,  Virginia 

Aberdeen  Proving  Ground,  Maryland 

Fort  Lee,  Virginia 

Fort  Monmouth,  New  Jersey 

Fort  Eustis,  Virginia 

Fort  Benjamin  Harrison,  Indiana 


COMBAT  TB3TS 


U.  3.  Arm}*  Infantry  School 


Fort  Bcnning,  Georgia 


Figure  3.  Army  torvice  tcHeolt  participating  in  development  of  situational  criterion 
performance  tetti 


THE  OFFICER  EVALUATION  CENTER 


The  Officer  Evaluation  Center  (CEC)  vas  established  as  a  class  II 
activity  of  The  Adjutant  General  (TAG)  1  March  1962,  with  station  at 
Fort  McClellan,  Alabanal/.  When  the  Anay  reorganization  resulted  in  the 
activation  of  the  Office  of  Personnel  Operations  (0P0)  1  July  1962,  the 
UEC  was  made  a  class  II  activity  of  0P0 2/.  Within  0P0,  the  OEC  became  a 
responsibility  of  the  Executive  for  Career  Planning,  Officer  Personnel 
Directorate.  The  table  of  distribution  provides  for  17  officers  and  4l 
enlisted  men. 

Ih  May  I962,  the  first  of  the  commissioned  staff  vere  wn  duty  at 
Fort  McClellan  bo  take  up  the  work  of  funding,  manning,  and  equipping 
the  center,  refining  cost  estimates,  and  arranging  for  building  modifica¬ 
tions  and  logistical  support  from  Fort  McClellan.  The  cannon! ing  officer 
and  the  first  of  his  comissioned  staff  to  become  available  were  briefed 
at  the  U.  S.  Arsy  Personnel  Research  Office  (U3APK0)  in  Washington  before 
proceeding  to  Fort  McClellan.  The  briefings  covered  the  officer  predic¬ 
tion  research  in  general,  basic  concepts  of  psychological  measurement, 
and  plans  for  the  CEC  Lo  administer  the  situational  criterion  exercise. 
USAFRO  personnel  then  accompanied  the  CEC  officers  to  Fort  McClellan  t- 
orient  CEC  personnel  in  the  administration  of  the  si-cuational  tests  of 
the  Differential  Officer  Performance  Battery.  At  the  end  of  1 962,  an 
APRO  research  psychologist  was  recruited  specifically  to  be  the  Officer 
Prediction  Task  psychologist  in  residence  at  the  OEC. 

The  APRO  research  psychologists  who  had  "authored"  the  tests  provide 
the  CEC  comaissioned  staff  with  detailed  orientation  on  the  alrainistriM  u 
and  recording  of  each  teat  (Figure  4).  Officers  in  charge  of  testing 
team  then  gave  detailed  instructions  to  their  enlisted  team  monbeiv, 
with  the  teat  authors  present  for  Continuing  guidance.  During  this  pfcn  e 
of  the  testing  process,  examinee  roles  were  played  by  OEC  staid'  memo'-  •  . 
Examiner  roles  vsrs  rotated  to  provide  cross  training.  At  first,  c:.cn 
situational  test  vas  conducted  separately,  testing  a  single  examinee. 
Gradually,  integration  of  the  tests  into  a  MAAG  narrative  was  undertaken, 
and  two  cr  three  examinees  werv  tested  simultaneously.  By  the  end  of 
Jeptembor  1962,  related  tests  vere  being  administered  to  six  examinees 
simultaneously— the  intended  pattern  of  Center  operation.  Ue-af  the  ont 
of  19<52,  a  total  of  12  tests  was  first  administered  in  sequence  in  an 
integrated  MAAG  narrative.  Lieutenants  made  available  by  rort  McClellan 
activities  vere  introduced  as  trial  examinees— first  singly  and  finally 
in  pilot  groups  of  six  examinees  at  a  time.  The  (EC  vas  new  ready  to 
begin  shakedown  operation— evaluating  the  first  groups  of  lieutenants 
previously  tested  with  tbs  Differential  Officer  Battery  of  experimental 
predictor  tests  (Figures  5,  6,  j). 


l/  DA  General  Orders  No,  10,  dated  26  February  1^62. 
2/  DA  General  Orders  No.  35/  dated  19  June  1962, 
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While  this  teem  training  vas  in  progress,  Officer  Prediction  Task 
psychologists  (the  test  authors)— in  consultation  with  the  various  test¬ 
ing  officers  and  the  QEC  conmander  and  his  operations  staff— vere  taking 
advantage  of  the  experience  of  actual  conduct  of  the  tests  to  introduce 
modifications  and  refinements  in  test  content,  in  the  scoring,  and  in 
the  MAAG  narrative. 


OEC  Shakedown  Operation 

The  first  group  of  six  lieutenants  previously  tested  with  the  DOB 
performed  the  CSC  exercise  in  February  1963*  Scheduling  is  in  two-week 
cycles,  with  two  groups  entering  one  week  and  one  group  the  next.  The 
selected  lieutenants  reach  the  QEC  after  18  months  of  active  duty.  They 
are  selected,  to  the  maximum  extent  possible,  so  that  each  six -man  group 
includes  two  with  technical  background,  two  with  administrative  back¬ 
ground,  and  two  with  a  background  of  combat  assignment. 

Shakedown  operation  of  the  OEC,  with  lieutenants  as  examinees , 
occupied  the  first  half  of  1963.  During  this  period  also,  as  a  result 
of  the  determination  that  there  was  insufficient  technical,  coverage  in 
the  Differential  Performance  Battery,  three  new  technical  measures  were 
developed,  tried  out,  and  introduced  into  the  total  HAAG  exercise. 
Finally*  in  order  to  obtain  auxiliary  criterion  information  (branch  and 
Job  satisfaction  and  strength  of  career  intention),  the  Officer  Assign¬ 
ment  Questionnaire  was  introduced  for  administration  to  each  lieutenant 
upon  arrival  at  the  OEC.  Except  for  the  completely  new  technical  tests, 
most  data  collected  during  this  period  could  be  regarded  as  validation 
data.  By  July  1963,  all  measures  vere  in  final  form  and  testing  with 
the  complete  DOPB  ccenenced  for  the  record. 


THE  VALIDATION  SAMPLE 

The  overall  schema  for  validation  of  the  Differential  Officer  Battery 
using  a  second  sample  of  officers  entering  active  duty,  is  essentially 
that  originally  intended  for  the  1958-1939  sample.  Officers  entering 
active  duty  were  given  the  predictor  battery  at  their  branch  schools 
before  beginning  their  Officer  Orientation  Course.  From  June  1961 
through  FeVruaiy  1963,  the  shortened  DCB  was  administered  to  nearly  3300 
selected  officers  entering  active  duty  in  nine  branches  (Figure  8). 
Officers  tested  at  the  branch  schools  were  for  tbs  most  part  those  having 
CONUS  assignment,  preferably  in  the  Southeastern  part  of  the  United  States 
In  order  to  minimize  travel  distance  to  the  OBC.  However,  exclusion  of 
all  overseas  assignees  was  not  possible  in  the  case  of  Ordnance  Corps  and 
Quartermaster  Corps  officers.  The  August  1962  orientation  classes  of 
Regular  Army  officers,  both  U.  8.  Military  Academy  graduates  and  ROTC 
Distinguished  Military  Graduates,  vere  included  in  the  testing.  After 
about  18  months  of  active  duty,  officers  selected  primarily  on  the  basis 
of  duty  assignment  are  assigned  to  the  CEC  to  go  through  the  situational 
performance  exercise. 


Branch  School 

Ho.  of  Examinees 

Infantry  (Benning) 

398 

Armor  (Knox) 

371 

Artillery  (Sill  and  Bliss) 

396 

Engineer  (Belvoir) 

277 

Signal  (Monmouth  and  Cordon) 

203 

Ordnance  (Aberdeen )a 

991 

Quartermaster  (Lee)a 

526 

Adjutant  General  (Benjamin  Herrison) 

185 

Finance  (Benjamin  Harrison) 

111 

TOTAL 

3^3 

*Some  ovtriui  maalgneea  tastmd  in  Ordnance  and  QwrttnuiUr  Corps 


Figure  3.  Selected  newly  cemmiitioned  oHicert  tested  with  Differential  Officer 
Battery  June  1961-Fefcruary  1963 


As  with  the  earlier  Maple  of  predictor  examinees,  punched -card 
decks  obtained  on  a  regular  basis  fresi  The  Adjutant  General's  Office 
show  current  organizational  address  of  all  lieutenants  who  took  the  DOB 
during  I96I  and  1962.  Beginning  in  the  latter  part  of  1962,  inquiries 
have  been  nailed  to  field  organizations  of  successive  waves  of  DOB 
examinees.  The  organisations  are  asked  to  provide  descriptions  of  the 
Job  duties  of  tbs  officers  In  question  and  ratings  of  their  duty  per¬ 
formance.  Performance  ratings  Obtained  from  each  officer's  immediate 
supervisor,  an  additional  superior,  and  two  close  associates  will  permit 
comparison  of  rating  criteria  of  this  kind  with  the  situational  criterion 
Obtained  at  the  OEC.  Duty  descriptions  obtained  from  all  raters  and  from 
the  offioer  himself  provide  the  basis  for  selection  of  officers  to  go  to 
Fort  McClellan  to  receive  situational  criterion  measurement  and  also  for 
determination  of  ratee  samples  for  analysis.  Thus,  the  rating  criterion 
is  obtained  on  all  DOB  examinees  whether  or  not  they  are  selected  for 
OEC  evaluation. 

A  criterion  evaluation  sample  of  90O--JOO  each  with  technical, 
administrative,  and  saefcat  command  background--!#  considered  minimal. 
Because  the  input  rate  of  exar  jet  lieutenants  to'  the  OEC  is  lowdr  than 
ant^-ipa4.  :d  (42o  rather  than  600  per  year),  and  because  of  delay  in 
beginning  CEC  operation,  the  existing  examinee  pool  of  two-year  reservists 
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will  lea*'*  active  duty  before  the  necessary  number  can  receive  situational 
criterion  measurement.  In  order  to  provide  the  requisite  pool  for  cri¬ 
terion  meas'urement  at  the  Center  during  the  first  half  of  1965,  additional 
officers  ertcrtng  active  duty  during  1964  will  be  given  the  DOB.  Current 
plans  call  for  \ce  Officer  Evaluation  Center  to  operate  through  June  1965. 
Throughout  this  period,  Job-duty  information  and  performance  ratings  will 
be  obtained  by  mail  on  successive  waves  of  DOB  examinees,  and  selection 
of  DOB  tested  officers  to  receive  orders  to  the  Center  will  continue. 


CURRENT  SVTUS  OF  THE  PROGRAM 

To  summarize,  in  tno  first  quarter  of  calendar  year  lyG4,  progress  of 
Officer  Prediction  research  stands  as  follows: 

1.  The  Differential  Officer  Battery  of  experimental  tests  has  been 
developed  through  successive --and  sometimes  repeated- -stages  of  planning, 
construction,  a  priori  refinement,  experimental  administration  to  6500 
officers,  analysis  of  content  against  the  criterion  of  rated  officer 
performance,  selection  of  content  based  on  results  of  the  analysis,  and 
organization  into  appropriate  form  for  administration,  together  with  the 
necessary  auxiliary  testing  materials. 

2.  ..he  experimental  Differential  Officer  Battery,  in  revised  and 
shortened  form,  has  been  administered  to  a  second  sample  of  35^0  incoming 
officers  from  which  samples  of  officers  performing  primarily  in  technical, 
administrative,  and  combat  assignments  are  selected.  In  the  selected 
sample,  predictor  scores  will  be  analyzed  in  relation  to  situational  per¬ 
formance  criteria  to  determine  the  differential  predictability  of  techni¬ 
cal,  administrative,  and  combat  officer  performance.  Additional  testing 
of  incoming  officers  is  t>  *heduled  as  a  Mans  of  insuring  a  sufficient 
number  of  DOB  tested  officers  with  a  year  or  sore  of  experience  to  com¬ 
plete  the  criterion  sample.  Duty  descriptions  and  Job  performance  ratings 
are  obtained  on  the  DOB  examinee  sample.  The  Job  description  information 
serves  as  a  basis  for  eelectin,  officers  for  the  situational  criterion 
sample. 

3.  Situational  teats  to  constitute  the  Differential  Officer  Per¬ 
formance  Battery  have  been  devised  to  measure  officer  performance  in 
representative  situations  occurring  or  expected  to  ocev.  in  officer  Jobs. 
Through  repeated  review,  tryout,  and  field  testing,  tbs  test  situations 
have  been  forged  into  the  present  officer  performances  exercise,  consist¬ 
ing  of  five  technical  situations,  five  administrative  situations,  and 
five  combat  situations. 

4.  The  Officer  Evaluation  Center  has  been  established  at  Fort 
McClellan,  Alabama  for  the  purpose  of  administering  the  situational 
criterion  tests  to  officers  in  the  differential  validation  sample. 

During  the  early  months  of  the  Center's  existence,  activity  focused  on 
integrating  the  situational  performance  tests  into  a  continuous  exercise 
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taking  place  In  a  blaulated  KftAO  setting*  Shakedown  runs  here  teen  oan> 
plated  la  which  the  entire  evaluation  exercise  was  adnlnistered  to  groups 
of  officers  previously  tested  with  the  DCB. 

5<  Officers  of  the  "for  the  record"  validation  sample  are  now  being 
tested,  three  six-men  groups  in  each  tvo-veek  period.  Ongoing  procedures 
continue  for  obtaining  Job -duty  information  and  perfornnnee  ratings  by 
mail  on  successive  waves  of  DCB  examinees  from  whom  officers  are  selected 
to  go  through  the  situational  test  exercise  at  the  Center. 

6.  Statistical  processing  of  situational  test  data  and  auxiliary 
criterion  data  has  been  initiated. 

7.  Preparatory  to  differential  validity  analysis  of  predictors, 
considerable  statistical  processing  and  analysis  of  the  data  need  to  be 
accomplished.  Analysis  of  predictors  in  the  initial  rated  officer  sample 
(1958-1959)  was  directed  toward  identifying  the  more  valid  content  of  the 
predictors  assembled  for  tryout.  Further  analysis  of  these  data  has  been 
undertaken  to  organize  officer  responses  into  scores  which  will  be 
psychologically  meaningful  for  officer  career  orientation.  Specifically, 
subscores,  or  keys,  for  the  self -description  and  interest  questionnaires 
representing  recognized  psychological  dimensions  have  to  be  developed  on 
the  basis  of  results  with  the  1961-1962  sample.  Job -oriented  keys 
derived  empirically  on  the  195fl_1959  sample  are  already  available. 

Coordination  is  In  progress  for  collection  of  data  used  operation¬ 
ally  in  ROTC  selection  and  branch  and  duty  assignment  of  the  two-year 
reservists  who  took  the  D®-v  ®}ia  information  consists  primarily  of 
records  obtained  from  ROTC  sources,  and  includes  the  score  obtained  by 
each  officer  on  the  ROTC  fetal lfylng  Examination  (RQ),  his  college  major 
and  grade -point  average  in  his  college  counts,  bis  stated  preference 
for  branch  assignment,  and  similar  background  information.  In  addition, 
undergraduate  data  and  branch  preferences  are  obtained  for  the  Regular 
Amy  affioera  in  the  Semple,  Including  both  U.  3.  Military  Academy 
graduates  and  Distinguished  Military  graduates  of  the  ROTC  program. 


MtOJfCTED  VALIDITY  ANALYSIS 

fha  tcchalcal,  administrative,  sad  eafeat-type  performance  scores 
nahievsd  by  900  lieutenants  at  ths  Officer  Evaluation  Center  constitute 
the  yrinolgal  criterion  for  tasting  the  "Minimum  hypothesis"  of  this 
research— namely,  that  abilities  to  neat  the  differing  psychological 
requirements  of  technical,  administrative,  and  codbet-type  officer  Jobs 
are  differentially  predictable. 

For  all  900  officers  selected,  there  will  be  situational  criterion 
■cores  in  technical,  administrative,  and  ccntoat-type  performance,  plus 
auxiliary  criterion  measures  of  branch  and  Job  satic^acticn  and  strength 
of  career  intention.  Xn  addition,  information  an  whether  the  officer 
elected  to  remain  in  service— or  was  retained- -will  become  available  for 
the  two-year  reserve  officers  in  the  total  sample  as  their  terms  of 
obligated  service  expire. 


-  18  - 


The  first  differential  validity  analysis  will  bs  undertaken  in 
1 964-1965  based  on  criterion  cases  processed  by  a  cut-off  date  (to  be 
established).  Further  validity  analysis  will  be  conducted  sequentially 
thereafter  as  data  are  collected  on  sufficient  numbers  of  officers.  The 
validity  analysis  will  follow  two  main  currents.  The  primary  test  of 
the  differential  predictability  of  performance  in  three  major  types  of 
officer  assignment  will  center  in  the  CSC  sample  of  900  officers.  The 
primary  questions  to  be  answered  by  this  analysis  will  be: 

1.  Does  the  experimental  measure  or  set  of  measures  developed  (in 
the  1958-1959  sample)  to  predict  successful  performance  in  a  given  job 
area  have  higher  validity  for  that  area  than  for  other  areas'; 

2.  Does  it  have  higher  validity  for  that  area  than  do  measures 
developed  to  predict  success  in  other  areas'; 

Affirmative  answers  will  indicate  that  differential  prediction  is 
occurring.  Relative  success  of  the  experimental  predictors  will  con¬ 
stitute  a  basis  for  selection  and  refinement  of  measures  for  operational 
use.  This  objective  will  be  pursued  through  analysis  of  lesser  com¬ 
ponents  of  predictor  scores— even  officer  responses  to  individual  items 
in  the  tests,  if  necessary--egainst  the  situational  performance  criteria. 

There  is  a  further  question--and  one  vital  to  the  contribution  of 
the  research  to  officer  career  management :  iioeB  the  experimental  pre¬ 
dictor  improve  on  the  selectors  now  in  operational  use,  or,  if  used  in 
combination  with  the  operational  selectors,  does  it  add  to  the  effective¬ 
ness  of  selection  procedures!  An  affirmative  answer  to  this  question 
will  indicate  a  potential  gain  to  the  Army  over  the  personnel  management 
tools  now  available. 

Also  in  the  CSC  sample,  the  validity  of  the  predictors  will  be 
examined  against  auxiliary  criterion  measures  of  branch  and  job  satis¬ 
faction  and  strength  of  oareer  Intention  to  determine  whether  means 
exist  for  placing  newly  commissioned  officers  in  branch  and  job  assign¬ 
ments  which  will  enhance  their  feelings  of  satisfaction  and  their  dis¬ 
position  to  bsoone  oareer  officers.  Finally,  the  inter-relationshlp3  of 
the  situational  criterion  aeoree,  the  auxiliary  criteria,  and  job  per¬ 
formance  ratings  obtained  by  mail  will  be  examined. 

In  the  larger  group  for  whom  ratings  are  obtained  by  mail,  the  three 
types  of  predictor  (operational  data,  Job-oriented  DOB  subscores,  and 
subject-matter  DOB  eubsooree)  will  be  validated  by  a  similar  differential 
analysis.  The  sample  will  be  broken  down  Into  subgroups  matching  those 
analysed  in  the  1998-1959  examines  staple.  Since  these  subsaoples  repre¬ 
sent  a  more  refined  breakout  of  officer  Jobs  than  do  the  three  broad 
categories  of  CEC  examinees,  favorable  outcome  of  analysis  in  these 
groups  may  permit  the  selection  of  predictor  content  for  operational  use 
over  a  fairly  wide  range  of  officer  job  types. 


PROJECTED  IMPLEMENTATION  OP  DOi  MIAIUEES  POE  OPEEATIONAL  USE 

Tte  Action  agency  for  executing  DC3FSR  personnel  policy  is  the 
OffiCA  of  Personnel  Operations  (OPC),  Implementation  of  officer  career 
policies  is  under  direction  of  the  Executive  for  Career  Planning, 

Officer  Personnel  Directorate,  who  also  has  command  responsibility  for 
the  QBC.  Aa  expressed  by  the  Executive  for  Career  Planning,  the  most 
iamedlate  interest  is  in  personnel  management  tools  applicable  to  RQTC 
graduates  in  General  Military  Science,  vho  serve  a  two-year  obligated 
tour.  Psychological  measures  would  be  appropriately  administered  before 
the  senior  year  of  college— probably  during  ROTO  uuaaer  camp,  when  peer 
or  other  evaluations  are  currently  obtained  for  later  conoideration  in 
career  orientation.  Scores  would  then  be  available  to  personnel  action 
agencies  for  duty  assignment  of  all  RCTC  men  serving  the  two-year  obli¬ 
gated  tour  and  for  guidance  in  branch  assignment  of  the  General  Military 
Science  students.  Scores  would  also  be  helpful  in  guiding  initial 
assignment  of  Distinguished  Military  Graduates  of  ROTC  commissioned  as 
RA  officers.  Scores  on  differentially  predictive  measures  could  also 
be  made  available  to  the  ROTC  student  for  purposes  of  self-analysis  and 
guidance  in  deciding  on  his  branch  preference. 

For  other  incoming  officers,  profiles  of  differential  scores  would 
be  useful  in  identifying  those  m  st  likely  to  succeed  in  specialized 
areas  of  assignment,  aa  well  as  those  matching  the  generalist  concept 
of  "all-round"  competence. 

Improvement  in  off icer , utilization  through  successful  differential 
prediction  should  lead  to  improved  military  effectiveness,  officer 
morale,  branch  and  Job  satisfaction,  career  attractiveness,  and  retention 
rate.  Through  analysis  of  the  several  predictor-criterion  relationships, 
there  should  also  be  aa  increased  understanding  of  the  differing  psycho¬ 
logical  requirements  of  different  kinds  of  officer  Jobs. 
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TECHNICAL  SUPPLEMENT 


TECHNICAL  SUPPLEMENT 


SECTION  I.  DEVELOPMENT  OF  THE  DIFFERENTIAL  OFFICER  BATTERY  (DOB) 
CONTENT  OF  INITIAL  BATTERY 

Fran.  October  1955,  vhen  officer  prediction  research  began,  to  July 
1557*  attention,  centered  on  development  of  the  expei'imental  predictor 
battery'.  The  initial  set  of  experimental  measures,  termed  the  Differen¬ 
tial  Officer  Leadership  Battery  (DQL),  vas  designed  to  reflect  both 
officer  characteristics  vhich  differ  in  importance  in  different  officer 
job  areas,  and  officer  characteristics  associated  with  officer  Job  success 
in  general. 


Self-Description  Instruments 


Personal  Data  Record  (PT  3397).  The  instrument  contains  55  items, 
iu  ref lectin;  socio-economic  status  and  25  reflecting  preferences  for 
school  subjects  and  school  achievement. 

Combat  Jelf -Description  Blank,  COMBIB-1  (PT  3203) «  The  instrument 
contains  25c  items  of  varied  format  measuring  aggressiveness,  individual¬ 
ism,  emotional  and  social  spontaaeousness,  and  various  work  interests. 
Content  vas  selected  on  the  basis  of  previous  resear  h  to  identify  effec¬ 
tive  combat  leaders. 

Officer  Leader  delf -Description  Blank,  DCUttB-1  (PT  5551).  This 
self -description  blank  contains  *fod  yes-noaad  2-choice  items  reflecting 
leadership,  Anay  adjustment,  suitability  for,  and  interest  in,  technical, 
administrative,  or  combat -type  Jobs,  and  specific  interests  in  ten  Job 
areas  previously  delineated  for  the  officer  MOS  analysis  (referred  to  on 
page  2). 


Information  Tost* 

Explicitly,  these  instruments  test  the  individual's  information  In 
various  subject-matter  areas,  on  the  hypothesis  that  information  reflects 
interest  in  those  areas. 

Tactics  Test,  IT-1  (PI  5221).  The  booklet  contains  115  items  on 
combat  tactics. 
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Logistic*  Teat  (Technical),  LOG(T)  -1  (PT  3220) •  The  booklet  contains 
107  items  on  tfechnicalServicea  hardware  lor  civilian  materiel  closely 
related  thereto). 


Logistics  lest  (Supply),  L0G(o)-l  (PT  3219)« 
120  items  on  supply  and  warehousing. 


The  booklet  contains 


Financial  Management  Test,  FI-1-1  (FT  3222).  Hie  booklet  contains 
122  items  on  market  transactions,  accounting  and  auditing,  and  business 
practice. 


General  Information  Test,  GIT,  Booklets  A  through  1  (FI  j2?0  through 
3281).  The  booklets  contain,  in  all,  644  items  covering  world  affairs, 
mechanics,  outdoor  activities,  science,  sports,  aesthetics,  uathmatics, 
recreation,  social  welfare,  and  miscellaneous  areas. 


Social  Perception  Test* 

Group  Awareness  Test,  Form  A  (PT  340J)  and  Form  B  (FI  ,~4j1) .  This 
test  is  an  empathy  measure,  in  which  the  examinee  uses  a  ^-stc-p  scale  to 
estimate  the  percentages  of  NCO's,  enlisted  recruits,  and  newly  commissioned 
ROTC  officers  agreeing  with  each  statement.  Kacii  form  cc>r«3ltit/o  01  f , 
statements.  The  forms,  presented  as  the  General  Opinion  Survey,  were 
administered  to  approximately  400  HCO's,  400  enlisted  recruits,  and  4uj 
newly  commissioned  ROTC  officers,  and  the  percentage  of  each  group  actual¬ 
ly  agreeing  with  each  statement  was  determined.  For  each  item,  the  ex¬ 
aminee's  score  is  the  number  of  scale  steps  his  answer  departs  from  the 
correct  answer  determined  by  actual  percentages  in  the  normative  groups. 

Individual  Understanding  Test,  Form  A  (PT  3403)  and  Form  B  (FT  34o4). 
This  test  is  ar  assumsd  similarity  measure.  Woe  examinee  uses  a  ^-step 
seal*  to  report  his  own  agreesant  or  disagreement  with  each  statement. 

On  a  second  answer  sheet,  he  uses  the  same  scale  to  estimate  the  responses 
of  the  "most  promising"  future  officer  (not  identified)  in  hie  ROTC 
class.  On  a  third  answer  sUset,  he  estimates  the  responses  of  the  "least 
promising"  future  officer.  For  each  item,  the  examinee  receives  three 
soores:  (1)  the  number  of  scale  steps  separating  his  own  response  from 
that  which  he  estimated  for  the  "most  promising"  officer,  (2)  the  number 
of  steps  separating  his  own  response  from  that  which  he  estimated  for  the 
"least  promising"  officer,  and  (3)  the  number  of  scale  steps  separating 
his  estimated  response  for  the  "most"  and  "least"  promising  officers. 


Tc»t  el  Commond  Judgment 

The  DQL  Battery  contains  one  test  designed  to  measure  the  examinee's 
ability  tc  make  sound  leadership  decisions  in  situations  involving  sub¬ 
ordinates. 

Speeded  Practical  Judgment  Test  (PT  3395).  A  me vie  film  adapted 
from  training  materials  developed  by  the  Human  Resources  Research  Office, 
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dramatizes  ten  problem  situations— there  is  an  initial  practice  situation. 
When  the  dramatized  sequence  reaches  the  point  requiring  the  commander* s 
decision,  the  dramatic  action  stops  and  four  possible  solutions  are  pre¬ 
sented  on  the  sound  track.  The  examinee  uses  a  4-step  scale  to  evaluate 
each  solution  independently,  under  conditions  of  closely  United  time. 


Tests  of  Physical  Skills  ond  Stamina 

The  manual  for  the  original  set  of  Tests  of  Fhysical  okills  and 
Stamina  (PSS-2)  (PT  3410 )  provided  for  six  measures: 

1.  150-yard  Shuttle  Run 

2.  Kneeling  Basketball  Throw 
3*  Vertical  Jump 

4.  Pull-ups 

5.  40-yard  Endurance  Crawl 

6.  Two-hand  Coordination  Teat  (DA  PRT  2617).  This  test  requires 
rapid  striking  of  styli  into  irregularly  arranged  half -inch  circles, 
alternating  single  strikes  between  left  hand  and  right  hand. 


P««r  Evaluations 


The  DOL  Battery  Includes  peer  ratings  as  experimental  differential 
predictors,  evaluations  being  obtained  after  seven  weeks  of  association 
during  initial  branch  training.  A  booklet,  Directions  for  Accomplishing 
the  Officer  Performance  Rating  Scale  (PT  3381),  provides  a  5-  step  scale 
for  evaluating  aaaoolates  on  three  separate  forma: 

Job  A,  Administrative  Leadership  (FT  3573) 

Job  B,  Tactical  and  Troop  Leadership  (PT  337 9) 

Job  C,  Technical  Leadership  (PT  3530) 


REFINEMENT  AND  SHORTENING  OF  THE  BATTERY 


The  initial  battery  required  three  days  for  adminiotratlon  of  the 
p&per-and-pencil  tests  and  an  additional  half  day  for  administering  the 
physical  proficiency  test  and  gathering  other  information.  In  this  form, 
the  battery  was  administered  to  an  input  officer  sample  of  65OO  on  wham 
Job  rating  criteria  accomplished  specifically  for  officer  prediction  re¬ 
search  were  later  obtained.  Administration  to  the  incoming  officers  was 
originally  intended  to  provide  the  sa&qile  in  which  the  differential 


-  25  - 


validity  of  the  instruments  would  be  tested  against  officer  performance 
on  the  situations!  tests.  All  officers,  BA  and  non-BA,  graduates  of  the 
U.  S.  Military  Academy,  and  Distinguished  Military  Graduates  of  ROIC, 
entering  active  duty  through  eleven  branch  schools  from  January  1558 
through  June  1955  constituted  the  sample  (Table  l).  According  to  the 
intended  schedule,  one  or  more  Officer  Evaluation  Centers,  each  manned  by 
some  50  or  more  military  personnel,  would  be  established  to  begin  sltua-' 
tional  testing  in  July  1959*  Somewhat  in  advance  of  that  date,  it  became 
clear  that  no  such  facilities  could  be  made  available.  In  order  tc  use 
to  best  advantage  the  data  already  collected,  APRO  quickly  formulated 
plans  to  obtain  special  on-the-job  criterion  ratings  of  as  many  as  possi¬ 
ble  of  the  6500  examinees  to  provide  an  external  yardstick  as  a  basis  for 
shortening  the  predictor  battery.  The  Human  Factors  Sub-panel  of  the  Army 
Scientific  Advisory  Panel  reluctantly  indorsed  the  proposal  while  still 
urging  that  the  validation  ultimately  include  the  situationax  performance 
criteria. 


Table  1 

NEWLY  COMMISSIONED  OFFICERS  TESTED 
WITH  DIFFERENTIAL  OFFICER  LEADERSHIP  BATTERY, 
JANUARY  1958  to  JULY  1959,  BY  BRANCH  SCHOOL 


Branch  School  IJp.  of  Examinees 


Infantry  (Benning) 

1,311 

Armor  (Knox) 

579 

Artillery  (sill  and  Bliaa) 

1,862 

Engineer  (Belvoir) 

1*07 

Signal  (Monmouth) 

642 

Ordnance  (Aberdeen) 

561 

Transportation  Corps  (Eustls) 

445 

Quartermaster  (Lee) 

371 

Adjutant  General  (Benjamin  Harrison) 

240 

Finance  (Benjamin  Harrison) 

86 

TOTAL 


6,502 


1 

Analysis  of  .battery  content  was  performed  in  two  phase_ :  an  internal 
analysis  of  information  test  items,  boxb  .general  and  in  specific  military 
Job  areas,  on  the  basis  of  responses  of  55 0  officers  examined  early  ir.  the 
predictor  data  collection  period;  and  a  validity  study  of  tc-st  content 
agai'  ut  on- jot  ratings  in  samples  t alien  from  the  total  i£?c>' of 
officers.  Through  these  analyses,  the  baiter;.*  was  pared  to  the  point 
where  only  two  days  and  two  hours  were  r-ii-arei  for  predictor  lata 
collection. 


Proliminory  Analysis  of  Information  Tost  Content 

On  the  basis  of  the  responses  of  the  f50  officers,  analysis  _f  the 
infomation  test  items  was  performed  in  order  to  cluster  the  items  ar.d 
provide  subscores  representative  of  the  subject-matter  areas  included  ir. 
the  644  items  of  the  General  Information  Test  and  in  the  specific  military 
subject-matter  tests. 

For  the  specific  information  tests— Tactics,  Logistics  (Technical), 
Logistics  (lupply),  and  Financial  Management— each  item,  in  a  gives,  tec*, 
was  biserially  correlated  with  total  score  on  each  of  the  four  tests  and 
also  with  total  score  on  the  644  general  information  items.  Tor  an  item 
to  be  selected  for  the  refined  subscore  in  a  test,  the  biserial  coeffi¬ 
cient  of  correlation  with  the  test  in  which  the  item  occurred  was  required 
to  be  of  suitable  magnitude  and  also  to  exceed  its  biserial  coefficii  nt 
correlation  with,  any  of  the  other  three  tests  involved.  Hccultc  are 
shown  in  Tabic  2. 


Table  2 

EFFECT  OF  ..SHORTENING  THE  FOUR  .SPECIFIC  IlffCEMATION  iEJTJ 
BY  INTERNAL  COIldLSTEUCY  AIJALYGIG 


Number  of  Items 

Name  of  Teat 

Original 

Test 

Items  selected 
in  preliminary 
analysis 

Tactics 

115 

6l 

Logistics  (Technical) 

107 

65 

Logistics  ( 3»pply) 

120 

50 

Financial  Management 

122 

57 

2ol 


TOTAL 


464 


Jliall«r  analysis  of  c&l  aroaral  lnfonoatloa  taat  Items  was  ««IhM 
by  correlating  eac:.  of  tha  644  items  with  each  of  the  originally 
eeivel  a. ib score  s  including  the  subscore  in  which  the  iter  occurred.  Sub¬ 
sequently,  the  clusters  .'ere  twice  revise-  ca  a  basis  of  review,  so  that 
the  finel  set  of  subsidies  were  not  derived  with  complete  depends -'ce  oc 
the  statistics.  The  eifect  of  these  steps  for  the  general  inToraatioc. 
is  shown  in  a. able  J. 


Table  J 


01 


oK0htk:ji::'!  ir-  ieieral  i.:?g?.ma~io:: 
by  iutermal  go::3I?.tc:cy  amalyjij 


vvi)  kllO«  > 


lumber  of  Itens 

Item;  selected 
Original  in  preliminary 

dubje-t  .>atter  Area  Test  analysis 


Organise!  dports 

lb- 

•1 

Mature  Jports 

22 

:.l 

Fan  7oct3 

31 

23 

Biology  and  Medicine 

31 

d 

Psychology  and  Psychiatry 

ii 

10 

Mechanical  Information 

30 

3,‘ 

Physics 

21 

Chemistry 

26 

22 

History  and  Philosophy  of  Science 

31 

lo 

Mathematics 

32 

* 

Gauss 

22 

13 

Art 

26 

17 

Music 

26 

13 

Entertain- ent 

21 

18 

Literature 

U7 

26 

World  Affairs  and  Polities 

37 

31 

Socio-Economic  yaets 

38 

19 

Quantitative  Miscellany 

21 

8 

Non-Quantitative  Miscellany 

44 

13 

TOTAL 

641 

401 
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Tlw  Rating  Criterion 


Special  instruments  were  devised  for  the  rating  criterion,  including 
a  special  scale  of  officer  performance  (Figure  9).  Beginning  early  in 
i960,  about  18  months  after  predictor  testing,  duty  performance  ratings 
vere  obtained  by  mail  from  each  officer's  immediate  supervisor,  an  addi¬ 
tional  superior,  and  tvo  close  associates.  The  officer  and  all  bis  raters 
vere  asked  to  describe  the  ratee's  actual  duties  tc  provide  a  basis  for 
determination  of  analysis  samples.  Table  U  shows  rater  inter correlation 
coefficients  for  all  hard-core  technical,  administrative,  arid  combat 
command  cases  with  four  raters.  On  the  basis  of  this  inter-rater  agree- 
m:.nt ,  it  was  estimated  tliat  the  reliability  coefficient  of  a  four-rater 
average  was  approximately  .73,  of  a  three-rater  average  approximately  .67. 
At  least  three  ratings  were  required  for  a  case  to  be  included  in  the 
samples. 

Jince  promotion  to  first  lieutenant  normally  occurs  upon  completion 
ox'  18  months  of  duty  as  a  second  lieutenant,  the  relationship  between  cri¬ 
terion  score  and  months  of  active  duty  was  examined,  separately  for  first 
and  second  lieutenants,  for  ail  hard-core  technical,  administrative,  and 
combat  officers  for  whom  months  ox'  active  duty  information  was  available. 
The  results  shown  in  Table  5  indicate  independence  of  criterion  scores 
from  length  of  active  duty  in  the  case  of  first  lieutenants;  but  for  the 
smaller  number  of  second  lieutenants  (averaging  over  IS  months  of  active 
duty;  criterion  3rores  were  found  to  average  lower  and  to  correlate  nega¬ 
tively  with  number  of  months  of  service. 


Th«  Analysif  Subsampl** 

Fran  descriptions  of  the  duties  the  officers  vere  performing,  sub- 
ssnples  consisting  of  technical,  administrative,  and  combat  examinees 
were  constituted,  based  on  strictly  circumscribed  concepts  of  the  duties 
included  xn  each  area  of  assignment.  The  hard-core  technical  sample  was 
limited  to  officers  with  assignments  as  technic*1  experts  directing  the 
installation,  operation,  maintenance,  and  repair  of  materiel  or  hardware 
equipment,  el char  electronic  or  mechanical  and  electric,  hard-core  ad¬ 
ministrative  cases  wore  officers  assigned  to  nomateriel  support  na iiage- 
ment,  including  general  administration,  staff  coordination,  and  super¬ 
vision  of  personnel,  finance,  and  records  activities.  The  hard-core 
combat  sample  consisted  of  officers  in  coarand  of  tactical  troops  usiig 
infantry  or  armor  weapons,  Including  command  of  trainees  in  Basic  Tombs t 
Training  and  Advanced  Individual  Training.  Five  additional  samples  were 
formed  to  represent  officer  assignment  in  artillery  command,  combat, 
staff,  logistics  (supply),  logistics  (technical),  and  logistics  (general). 
The  artillery  ccmand  and  combat  staff  groups  vere  considered  as  supple¬ 
mentary  combat  samples;  the  loglstxcs  (supply)  and  logistics  (general)  as 
supplementary  administrative  samples;  and  the  logistics  (technical)  as  a 
supplementary  technical  sample,  b ample  discs  and  descriptive  criterion 
data  for  all  hard-core  and  supplementary  samples  are  shown  In  Table  0. 
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omen  pbckiwce  scale 


WHAT  IS  YOCJR  OVER -ALL  JUDGMENT 
OF  THE  RATH)  OFFICER'S  PERFORMANCE  OF  THIS  DOTY? 


The  VERY  BEST  TYPE  OF  OFFICER  PERFORMANCE -hup  Inspiring  example  to  all. 

I  trust  hla  completely,  In  this  assignment,  to  know  what  la  to  be  done 
and  to  aee  that  it  la  done,  la  any  circuaetance .  Hla  performance  of 
thla  duty  la  far  above  the  require— nta  of  hla  situation,  suggesting  the 
highest  kind  of  formal  recognition  through  meritorious  award,  decora¬ 
tion,  or  accelerated  advancement  in  grade.  Thla  type  of  officer  la 
ideal  for  important  duty  in  this  kind  of  assignment. 


GOOD  OFFICER  PERFORMANCE.  He  has  more  than  enough  of  what  it  takes 


PERFORMANCE— the  backbone  of  the  officer  corps.  He  has 
i  to  succeed  i;i  this  assignment.  His  performance  of  thla 
to  tbs  require— nta  of  hla  situation,  suggesting  gep- 
Tpirissjs  mostly  unexpressed) . 


la  hM  vary  little  of  what  it  takes  to 
succeed  In  this  aaelgnmeot. His  parformanaa  of  thla  duty  ia  markedly 

2  below  tha  require— eta  of  hla  situation,  auggaatlng  fowl  corrective 
actlon~5Erougn  off -schedule  preparation  of  a  special  (unfavorable)  effi¬ 
ciency  report,  through  administrative  admonition,  letter  of  reprimand, 
or  summary  court,  or  through  transfer  out  of  the  organization. 


The  VORar  TYPE  OF  OFFICER  PBtfCTMANCE-a  total  threat  to  the  mission. 
Either  be  doesn't”  know  his~<fe,' ocr  be  can  not  or  will  not  perform  it  as 
required.  Bis  performance  of  this  duty  ia  far  below  the  requirements  of 
hla  situation,  suggesting  the  moat  drastic  kind”  of  formal~correctlve 
action  through  reclassification,  demotion,  general  court,  or  hoarding 
but  of  the  Army. 


t  i-lure  9  Officer  performance  sca*e  on  which  criterion  ratings  *ere  obtomed  for  analysis  of 
content  of  preliminary  predictor  battery 


Table  4 


INTERCOMS  ELATION  COEFFICIENTS  AMONG  RATINGS,  BY  TYPE  OF  RATER 
AND  AVERAGE  RATING  BY  FOUR  RATERS,  IN  HARD-CORE  JOB  SAMFLES 

(3  -  6-7) 


Rater 

Other 

Sup 

First 

Assoc 

Second 

Assoc 

AV£.  Of 
Four 

Immediate  Superior 

.47 

.41 

•34 

a 

•  O 

Other  Superior 

-39 

•  37 

•75  a 

First  Associate 

•  39 

•  74  a 

Second  Associate 

•  71  a 

a 

Pdft-Wht'Ie  relationship. 


Table  5 

MEANS,  STANDARD  DEVIATIONS,  AND  CORRELATION  COEFFICIENTS 
OF  CRITERION  SCORES  AND  MONTHS  ON  ACTIVE  DUTY,  B' 
GRADE,  IN  HARD-CORE  JOB  SAMPLES 


Criterion  Montho  on  Duty 


Grade 

a* 

it 

Mean 

8.P. 

Mean 

fl.9. 

r 

1st  Ltc 

703 

3.22 

0.60 

20  Sj 

2.0 

-.31 

2d  Lts 

163 

4.31 

0.20 

20.2 

3.4 

-.27 

TOTAL 

jb~Ji 

3.07 

0.63 

20.7 

3.0 

•  02 
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Table  6 


KEANS  A!®  STANDARD  DEVIATIONS  OF  CRITERION  SCORES  FOR 
THREE  HARD-CORE  AND  FIVE  SUPPLEMENTARY  RATING  CRITERION  SAMPLES 


Sample 

N 

Mean 

SD 

Hard-core 


Combat  Comsand  (inf  and  Amor) 

433 

5-09 

0.77 

Administrative  (Pure  Desk  Work) 

4oi 

p.19 

0.70 

Technical  Hardware  (High  Level) 

149 

5.42 

0.72 

Supplementary 

Artillery  Command  (FA) 

178 

5-03 

0.80 

Combat  Staff  (3-2  or  S-3) 

132 

5.09 

0.71 

Logistics  (Supply) 

161 

5.15 

0.78 

Logistics  (Technical) 

1?4 

5.14 

0.73 

Logistics  (General) 

120 

5.27 

0.77 

The  supplementary  samples  reflected  broader  and  more  inclusive  con¬ 
cepts  of  those  areas  than  did  the  throe  hard-core  a ample a.  Also,  the 
distinction  between  technical  and  administrative  areas  emphasized  the 
hardware  aspect  of  the  technical  criterion  area,  and  was  not  synonymous 
with  the  distinction  between  Technical  and  Administrative  Services  as 
connoted  by  the  Army  appellation*  For  example,  the  Quartermaster  Corps 
and  Transportation  Corps  are  Army  Technical  Services,  but  In  the  present 
research  Quartermaster  and  Transportation  Corps-type  activities  liave  been 
included  in  the  broader  (non-hard-core)  concept  of  the  administrative 
area. 


It*m  Data  Analytit  and  T**t  Raviiion 

Self -Description  Measures.  -All  three  self -description  instruments 
were  item-analyzed.  The  Personal  Data  Record,  which  is  relatively  short 
(55  items)  and  takes  only  30  min' '.tea  to  administer,  was  not  revised. 
However,  the  number  of  high  and  low  criterion  cases  in  each  of  the  eight 


subsamples  responding  to  each  option  of  each  item  was  recorded  to  provide 
means  for  later  development  of  empirical  sub scores.  For  both  the  Caabat 
Self-Description  Blank  and  the  Officer  Leader  Self -Description  Blank,  each 
option  of  each  item  was  biserially  correlated  vith  the  rating  criterion. 
Item  analysis  for  the  COMB IB  was  conducted  in  the  three  hard-core  sauries 
and  in  the  artillery  command  and  combat  staff  supplementary  samples. 

Item  analysis  of  the  DQLBIB  was  conducted  in  all  eight  samples.  In  both 
instances,  the  General  practice  was  to  retain  any  item  shoving  appreciable 
criterion  relationship  in  any  sample.  By  this  means,  the  COMB IB  was 
shortened  from  298  to  212  items,  the  DOLBIB  from  480  to  330  items.  These 
measures  became  the  Differential  Inventory,  Booklets  A  and  B,  respectively. 

Information  Tests.  In  the  case  of  the  information  tests,  items  were 
biserially  correlated  with  the  criterion  in  all  eight  samples.  For  the 
four  tests  of  specific  military  information,  means,  standard  deviations, 
and  criterion  correlation  coefficients  in  the  three  hard-core  samples 
were  computed  for  each  sub score  as  established  in  the  preliminary  content 
analysis  and  also  for  the  remaining  items  in  each  test  booklet.  Sequen¬ 
tial  test  selection  was  conducted  to  identify  the  best  three-test  com¬ 
bination.  Results  shown  in  Table  7  did  not  reflect  particularly  high 
validity.  It  was  therefore  decided  to  select  the  best  50  items  from  each 
specific  information  test.  In  the  case  of  the  General  Information  Test, 
items  vere  selected  at  large  from  the  6W+  items.  Any  item  showing  ap¬ 
preciable  criterion  relationship  in  any  of  the  eight  samples  was  retained. 
For  the  cluster  subscores  representing  subject-matter  areas,  average  item 
validity  biserial  coefficients  and  p- values  in  the  three  hard-core 
samples  are  shown  in  Table  8.  Results  of  shortening  the  information  tests 
by  item  validity  analysis  are  shown  in  libles  9  and  10.  The  shortened 
information  tests  were  printed  as  four  150-itea  booklets.  The  first  third 
of  each  booklet  consists  of  the  set  of  items  chosen  from  one  of  the 
specific  information  tests,  and  the  remaining  two- thirds  cover  general 
information  areas. 

Social  Perception  Measures.  Item  analysis  of  the  social  perception 
measures  (Group  Awareness  and  individual  Understanding)  was  conducted  in 
the  three  hard-core  samples  only,  by  product-moment  correlation  of  each 
of  the  item  deviation  scores  for  each  item  with  the  criterion  in  each 
sample.  I tom  selection  across  samples  resulted  in  the  reduction  of  the 
Group  Awareness  Tost  from  two  75-item  forms  to  one  75-ltem  booklet,  and 
the  reduction  of  the  Individual  Understanding  Test  from  two  75-ltem  forms 
to  one  75- item  booklet. 

Conmiand  Judgment  Teat.  In  the  case  of  the  Speeded  Practical  Judgment 
Test,  which  is  on  moving  picture  film  and  requires  a  special  answer  sheet, 
time  did  not  penult  any  attest  at  revision.  However,  in  the  three  hard¬ 
core  samples,  each  option  of  each  item  was  biserially  correlated  with 
the  criterion  to  provide  the  basis  for  later  development  of  e tapir i cal 
keys. 
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INFORMATION  TEST  SCORES  IN  THREE  HARD-CORE  SAMPLES 


l  Samples 

1  Admin  (N-40l) 

Teat  Key 

M 

SD 

M 

3D 

n 

mm 

3D 

■a 

Tactics 

j 

Items  selected  in 
preliminary  analysis 
(6l  items) 

39-1 

5-3 

•  17a 

37-1 

3.2 

.n° 

37-4 

4.9 

.09 

Remainder  (48  items) 

24.1 

4.2 

.12 

23.2 

4.1 

.05 

23.8 

4.2 

.it. 

Logistics  (Technical) 

Items  selected  in 
preliminary  analysis 
(65  items) 

28.7 

7.4 

.15° 

28.8 

8.4  • 

..07b 

35-3 

6.6 

.05 

Remainder  (44  Items) 

18.5 

3.3 

.09 

15.8 

3.7 

.04 

17.2 

3.6 

-.02C 

• 

Sterna  selected  U 
preliminary  analysis 
(JO  items) 

fiJ-9 

3.9 

.09 

26.7 

6.0 

.12* 

27.3 

6.0 

.14 

taalaAar  («9  itema) 

27.0 

4.6 

.05 

27.0 

4.9 

.00 

27.6 

3.3 

.04 

Steam  selected  in 
preliminary  analysis 
(87  items) 

37.4 

11.3 

-.05* 

41.5 

15.1 

.04 

37-3 

10.5 

.18* 

Remainder  (55  items) 

12.2 

2.6 

.06 

12.0 

2.9 

.08 

11.7 

3.0 

.08 

2-Teat  Multiple  R 

e» 

m 

.19 

m 

m 

*17 

m 

- 

.21 

5-Teat  Multiple  R 

- 

- 

.21 

- 

- 

.20 

m 

as 

.21 

«c«f*  Mi—tUlly  la»  ms  MSfto, 

SnmM  Mart  iMutlHy  MlictM  la  its  iMflt. 
flirt  MNv  safMMIrtiy  sslsstsd  Is  Ms  sss^U. 
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Table  8 

AVERAGE  ITEM-VALIDITY  BI3EFOAL  COEFFICIENTS  A.'2)  P-VALUCS  FOR  GENERAL 
INFORMATION  REFIiXD  K2YJ  IN  THREE  KAND-C0R3  SAMPLES 


Jangles 


Subject  Matter  Area 


No.  of 
Iters 


Oanbat 


Administrative 


technical 


Avg  r  Avg  p  Avg  r  Avg  p  Avg  r  Avg  p 


rganlzed  Sports 

34 

•on 

.61 

.04 

.62 

.01 

.61 

ature  Sports 

14 

.05 

.60 

-.01 

.56 

.00 

.56 

axe  Facts 

23 

.01; 

•  54 

.02 

.52 

.01 

.55 

iology  and  lx; di cine 

22 

-.01 

•  51 

-.01 

.49 

-.03 

.53 

’sychology  ar.d  Psychiatry 

10 

.00 

.41 

-.02 

.40 

-.04 

.39 

ie chanl cal  Information 

35 

.05 

.61 

-.05 

.61 

-.03 

.71 

hysics 

21 

.06 

•  56 

.04 

.56 

.01 

.77 

hemistry 

22 

.00 

.49 

.02 

.49 

-.04 

.68 

Istory  and  Philosophy  of  Science 

IS 

-.01 

.37 

-.01 

.36 

-.02 

.36 

lathematics 

36 

.05 

.58 

.01 

.57 

.03 

•  JJ 

aoea 

13 

*oe 

•53 

.00 

.53 

.  0*; 

.53 

•rt 

17 

*01 

•  37 

.00 

.36 

.02 

.36 

iuslo 

13 

-.03 

.40 

.01 

.42 

-.02 

.44 

ntertainmant 

>  IS 

.00 

•  32 

.01 

.54 

-.03 

•  53 

iterature 

2 6 

-.00 

*43 

.01 

.43 

.04 

.45 

orld  Affair*  and  Politic* 

31 

.01 

.37 

.01  . 

•55 

-.02 

.55 

ooio-Koonociio  Fact* 

19 

,02 

.47 

.01 

.46 

-.03 

.45 

uantitatlve  Miscellany 

8 

.04 

.56 

.00 

•  58 

-.02 

.62 

on-Quantitative  Miscellany 

13 

.02 

.62 

.04 

.65 

.01 

.62 

•ruble  9 


EFFECT  OF  SHORTENIX  THE  FOUR  SPECIFIC  INFORMATION  TESTS 
BY  ITEM-VALIDITY  ANALYSIS 


Name  of  Test 

No.  of  Items 

No.  of 

M 

I 

Vot 

.ala 

Sel.  in 
Prelim. 
Anal. 

Used  in 
Final 
Exper. 
Form 

Hoi 

Sel.  in 
Prelim. 
Anal. 

Used  in 
Final 
Exper. 
Fona 

Prelim¬ 

inary 

Final 

Tactics 

6l 

25 

48 

25 

109 

50 

Logistics  (Technical) 

63 

36 

44 

14 

107 

50 

Logistics  (Supply) 

50 

28 

69 

22 

119 

50 

Financial  Management 

87 

42 

35 

8 

122 

50 

TOTAL 

26l 

131 

196 

69 

457 

200 

5  niU  Me  mmSSnki 


Soores  on  all  alx  Physical  Skills  and 
Ith  the  criterion  in  all  eight  samples 
ae  above  In  Mbit  11.  The  reeulta  vert  disappointing,  but  in  order  to 
retain  acne  naaeureaent  la  thla  area#  vith  eaphaaie  on  the  combat  sample, 
the  Two-land  Coordination,  Kneeling  Basketball  Throw,  and  Endurance  Crawl 
teeta  were  aeleeted  for  inclusion  la  the  shortened  battery. 
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itttt CT  OF  SHCRZSKCK,  19  QSQ3UL  IWCBHmCBI  3UBTE3TS 
BY  rrEK-YALOITi  AliALYSIS  ••  • 


Subject  Matter  Area 

;jo.  of 

Items 

:;o.  of 

Items 

.  <-  ** 

ml 

Sel.  ir. 
Prelim. 
Anal. 

lised  in 
Final 

Ex  per. 
Form 

:.ct 

Jel.  In 
Prelim. 
Anal. 

Used  In 
Fi;*al 
iixper. 
Fort: 

r  . 

Inal 

Organized  Sports 

23 

12 

6 

4J 

29 

!:ature  Sports 

14 

10 

J 

r 

22 

15 

Farm  Facts 

23 

13 

11 

r, 

✓ 

34 

is 

Biolo gy  and  Medicine 

r\r- 

c  c 

13 

2 

6 

31 

15 

Psychology  and  Psychiatry 

10 

10 

6 

r.a 

✓ 

16 

1  •*& 

19 

mechanical  Information 

3: 

21 ' 

*  ii 

4 

50 

25 

Physics 

21 

13 

6 

4 

27 

17 

Chemistry 

22 

16 

4 

0 

26 

16 

History  and  Philosophy  of  Solan ot 

10 

0 

20 

7 

33 

15 

Math  tics 

36 

10 

16 

r» 

✓ 

r.o 

27 

Games 

13 

•  * 

7 

4 

22 

16 

Art 

It 

9 

6 

26 

13 

Music 

v> 

11 

6 

2C 

16 

Entertainment 

16 

» 

3 

3 

21 

13 

Literature 

2 6 

ao 

a 

12 

47 

32 

world  Affairs  and  Polltioa 

31 

u 

86 

19 

57 

31 

Jocio-Econonie  Facta 

12 

9 

19 

13 

30 

22 

Quantitative  Miscellany 

8 

7 

13 

9 

21 

16 

:.'on -Quantitative  Miscellany 

-li. 

— L 

JSL 

J&. 

44 

Jtk. 

iOwvL 

401 

23:. 

243 

14? 

644 

400 

|i»a«  in  ih#  ftithnlnff  and  *r*a  fin#i  iM  lafta*Kr<MN(  fad*  Ml. 


37 


'*<*''•* 


jjfafcftK.  m)  rtSTS  {CtOStML  SET): 

jjgjjtttit  ooprienara  against  rat*2k  crtesrioh 


Staple  (it) 


Sard-Core: 


Supplementary: 


■Beats  la  Qgder  of 
iketball  Vertical 

Throw  Juzsp 


Lstretlon 
L-  Endurance 

s  Crawl* 


Coord 


Coabat  (433) 

.00 

•  .10 

•  05 

,03 

-.11 

.15 

Adoln  (401) 

-.06 

-.04 

.06 

.02 

-.06 

.02 

Uecfa  (X49) 

••09 

-.10 

-.03 

-.04 

.01 

.11 

Artillery  (178) 

-.02 

.06 

.01 

.04 

-.12 

-.10 

Ooab  Staff  (132) 

.00 

.09 

-.03 

.03 

-.08 

.03 

Jot  (I Mb)  U7*0 

.11 

••03 

-.12 

-.06 

.08 

.06 

u*  (9wtor)  U&) 

.06 

.02 

.02 

.00 

.06 

ut  (o«0  (iac) 

*** 

.11 

.14 

.06 

-.04 

.22 

1WHMWMI. 


,  wa  •  M*RU**  •«n*UllM  ■  ••ttlcl.nl  Mtcate.  p..iu** 
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SECTION  II.  DEVELOPMENT  OF  SITUATIONAL  CRITERION  TESTS 


Initial  Ta*t  Centant  and  Ta*t  Summaries 

The  initial  sources  for  situational  test  content  in  all  three  areas 
were  the  I-1QS  descriptions.  Technical  and  Field  Manuals,  and  related  publi¬ 
cations  which  had  already  provided  the  basi6  for  preliminary  grouping  of 
officer  jobs  and  the  delineation  of  three  broad  job  areas.  These  ma¬ 
terials  had  aiso  guided  development  of  the  specific  information  tests  of 
the  predictor  battery. 

For  the  technical  and  administrative  areas,  outlines  of  criterion 
test  coverage  had  been  prepared  by  September  1957*  Expansion  of  situa¬ 
tional  test  ideas  into  tvo-page  summaries  was  completed  while  development 
of  tests  in  the  combat  area  was  still  in  the  exploratory  staee.  In  all, 

31  test  summaries  were  prepared  for  the  two  areas.  By  the  end  of  Sep¬ 
tember  I35O,  APRO  personnel  had  completed  review  of  the  31  teclinical  and 
administrative  test  summaries  with  appropriate  Army  specialists.  Mix 
teclinical  and  six  administrative  tests  were  chosen  for  further  develop¬ 
ment. 


In  the  combat  area,  further  guidance  was  obtained  by  interviewing 
combat  experienced  officers  in  the  V.’ashington  area,  viewing  combat  films, 
and  examining  combat  histories,  training  films,  and  Army  Training  Tests. 
Also,  conferences  were  held  with  combat-experienced  officers  at  the 
Infantry,  Armor,  Artillery  and  Missile,  and  Air  Defense  Schools.  Con¬ 
ferences  were  also  held  at  the  Army  War  College,  Carlisle  Barracks, 
Pennsylvania,  at  the  Combat  Developments  Experimentation  Center,  Fort  Ord, 
California,  and  with  GFFTRAIW  and  JLAWRAIU  task  personnel  at  the  U.  o. 
Army  Leadership  Human  Research  Unit,  Monterey,  California.  An  overall 
concept  of  situational  test  coverage  and  a  list  of  potential  test  ideas 
were  developed  for  the  combat  are**  At  this  point  (1958),  arrangements 
were  made  for  a  specially  constituted  panel  of  civilian  psychologists  to 
review  the  research  approach  to  the  oambat  criterion,  th?  overall  concept 
of  situational  test  coverage  In  the  combat  area,  and  the  potential  test 

ideas'^ . 

Since  all  criterion  examinees  were  to  perform  all  situational  tests, 
ideas  for  the  combat  officer  testa  were  based  on  branch  immaterial  prob¬ 
lems  not  requiring  specialised  armor  or  artillery  training.  Arrangements 


2/tk e  panel  consisted  of  Dr.  John  C.  Flanagan,  President  and  Director  of 
Research,  American  Institute  for  Research;  Dr.  John  K.  Hemphill, 
Research  Associate,  Educational  Testing  Service;  and  Dr.  Robert  L. 
Thorndike,  Chairman,  Psychology  Department,  Teachers  College,  Columbia 
University. 
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were  made  for  review  of  situational  test  material  of  a  generalized  combat 
nature  at  the  Infantry  School,  Fort  Benning,  Georgia.  In  October  and 
November  1953,  APFO  research  scientists  spent  19  man-weeks  with  experts 
of  the  F anger  Department,  Delta  Committee,  and  Platoon  Tactics  Cccmittee 
at  Fort  Denning  developing  situational  test  summaries  for  the  combat  area. 
After  appropriate  revision,  eight  combat  test  summaries  were  identified 
for  further  development.  The  selection  was  aided  by  consultation  with 
specialists  oi’  the  Infantry,  Armor,  Artillery  and  Missile  School,  and 
from  U3C0NARC,  who  can.0  to  Washington  for  the  purpose. 

In  all  three  areas,  overall  coverage  and  test  summaries  were  pre¬ 
pared  with  a  view  not  only  to  representative  military  requirements  but 
also  toward  development  of  a  realistic  and  meaningful.  KAAG  narrative. 

In  each  broad  area  a  tabulation  was  prepared  showing  the  military- 
psychological  factors  to  be  measured  by  each  test.  (Figure  10). 


Droh  Scenario*  of  Test  Action 

To  expand  the  test  summaries  into  scenarios  specifying  the  sequence 
of  test  action  and  to  establish  the  precise  aspect  of  t„o  acuion  to  be 
scored,  APRO  research  psychologists  had  to  work  Jointly  with  Amy  subject- 
matter  experts.  During  the  first  half  of  1959,  APRO  personnel  visited  the 
following  schools  to  develop  the  action  for  the  technical  and  administra¬ 
tive  tests:  Idie  Engineer  School  at  Fort  Belvoir,  The  Adjutant  General 
School  at  Fort  Benjamin  Harrison,  The  Quartermaster  School  at  Fort  Le*', 

The  Transportation  School  at  Fort  Eustis,  and  The  Signal  School  at  Fort 
Monmouth.  In  addition,  further  scenario  development  for  one  set  ox  tests 
linked  by  the  story  line  of  the  MAAG  narrative  was  conducted  in  Washington 
in  consultation  with  Engineer,  Quartermaster,  and  Transportation  Corps 
experts.  Through  DCSFER  coordination,  a  field-grad?  combat  officer  was 
designated  to  work  with  USAFRO  personnel  in  expanding  the  combat  officer 
teat  auxiliaries  into  draft  scenarios  and  in  identifying  points  to  be 
scored. 

The  draft  sotnarioa  ware  given  trial  administration  before  being  put 
into  teat  font,  in  order  to  check  on  feasibility  of  administration, 

naturalness  of  dialogue,  realise,  military  neaningfulnesB,  observability, 
and  practicability  tor  scoring  purposes.  IXiring  this  phase,  further  de- 
velopaent  and  revisions  in  sotnarioa  and  score  sheets  were  accomplished. 
For  the  teohnioal  and  administrative  testa,  task  personnel  conducted  the 
developmental  trials  in  oollaboratloo  with  appropriate  subject-matter 
epeoialiats,  primarily  at  the  Quartenaaater,  Signal,  and  Transportation 
Schools.  By  coordination  vith  U3C0NARC,  all  developsaental  field  work  on 
the  ooabat  officer  test  problems  was  dona  at  Fort  Georgs  0.  Meade, 
Maryland.  A  full-tins  project  officer  and  an  enlisted  teem  of  the  Third 
Armored  Cavalry  Regiment  worked  Jointly  with  AFRO  personnel  in  field 
development  and  revision  of  the  o'Vfcat  scenarios. 


Figure  10.  Military-ptychologieol  b*h«viore  in  »ituotionel  criterion  performance  te»f*. 


Vilien  in  nlcb»1959  DCoPER  determined  there  vas  no  possibility  of 
establishing  one  or  more  officer  evaluation  centers  with  sufficient  per¬ 
sonnel  to  administer  a  five-day  situational  criterion,  the  six  technical, 
six  administrative,  and  eight  combat  test  problems  were  further  reduced 
to  three  technical  (ore  very  elaborate),  four  administrative,  and  five 
combat  tests.  During  1959  and  i960,  the  Task's  main  effort  was  the  ex¬ 
pansion  of  these  twelve  situational  test  scenarios  into  full  test  presen¬ 
tation.  Work  began  on  the  preparation  of  manuals  for  the  twelve  tests. 

To  provide  flexibility  for  possible  later  use,  each  situational  test 
manual  vac  so  constructed  that  the  performance  test  could  be  adminis¬ 
tered  either  by  itself  or  jointly  with  other  tests  in  a  total  narrative 
framework. 

For  each  test,  the  basic  scenarios,  scoring  instruments,  and  other 
supplemental  materials  were  organized  into  standard  manual  format  with 
structure  as  typified  in  Table  12.  As  each  manual  vas  completed,  it  was 
forwarded  for  quantity  reproduction  with  the  intention  that  printed 
manuals  be  taken  to  the  appropriate  branch  schools  for  critical  review 
and  indorsement  by  subject-matter  experts  of  the  school  faculty. 


Review  and  Field  Tryout 

Review  at  Branch  Schools.  By  arrangement  with  USCOHARC,  all  situa¬ 
tional  test  manuals  were  reviewed  and  tried  out  at  the  cognizant  Branch 
Schools:  The  Quartermaster  School  (Fort  Lee);  The  Adjutant  General's 
School  (Fort  Benjamin  Harrison);  The  Transportation  School  (Fort  Eustis); 
The  Signal  School  (Fort  Monmouth);  The  Engineer  School  (Fort  Belvoir); 
and  The  Infantry  School  (Fort  Benning). 

At  each  school,  faculty  experts  reviewed  test  content  from  the  point 
of  view  of  military  meacingfulness  and  technical  accuracy,  checked  the 
scoring  and  relative  weights  where  pertinent,  collaborated  with  APRO  re¬ 
search  scientists  in  aaking  needed  revisions,  and  gave  their  Indorsement 
to  the  revised  manuals.  Each  test  was  then  administered  to  six  lieu¬ 
tenants,  sens  with  relevant  experience  and  some  without,  for  further 
verification  of  feasibility  and  adequacy  of  instructions,  and  for  the 
sxperlence  gained  in  training  personnel  to  administer  the  tests.  All 
five  oonbat  officer  tests  were  reviewed  and  tried  out  in  this  manner  at 
the  Infantry  School,  Fort  Benning,  Georgia. 

Tryout  at  the  OEC.  When  the  Ufficer  Evaluation  Center  was  eotab- 
llshed  at  Fort  McClellan,  Alabama,  and  the  first  few  officers  of  its 
staff  had  reported  in,  the  work  of  tryout  and  modification  continued  at 
the  new  location.  After  seeing  the  total  structure  of  the  situational 
testa  in  operation  for  the  first  time,  research  personnel  decided  that 
there  were  insufficient  measures  in  the  technical  area.  Further,  one 
test  designated  technical  was  found  not  to  have  substantive  technical 
content,  and  it  was  redesignated  an  administrative  test.  Therefore, 
beginning  in  January  19^3,  s  crash  program  to  develop  three  more  techni¬ 
cal  tests  was  undertaken. 


TYPICAL  STRUCTURE  OF  SITUATIONAL  TEST  MANUAL 
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The  experience  of  Task  personnel  in  developing  the  twelve  original 
tests  permitted  some  shortcuts  in  this  nev  effort,  although  contact  was 
maintained  with  the  cognisant  schools  and  with  other  subject-matter  ex¬ 
perts.  Manuals  were  assembled  following  the  already  established  pattern, 
and  dry-run  trials  were  conducted  at  the  OEC  itself.  By  the  end  of  June 
1963,  all  measures  were  operating  in  final  form  at  the  Center. 

After  the  OEC  staff  had  reached  full  strength  and  had  become  profi¬ 
cient  in  administering  the  situational  measures  (first  singly,  and  then 
as  an  integrated  exercise),  pilot  groups  of  locally  obtained  lieutenants 
were  tested.  The  period  of  shakedown  operation  continued  through  June 
1963.  Detailed  refinements  in  individual  tests  and  the  overall  MAAG 
narrative  were  worked  out. 

In  final  form,  the  Differential  Officer  Performance  Battery  consists 
of  15  situational  tests— five  technical,  five  administrative,  and  five 
combat.  Figure  10  shows  the  general  structure  of  military-psychological 
measurement  in  the  total  exercise. 


SECTION  III.  PLANNED  STATISTICAL  PROCESSING  AND  ANALYSIS 

Officer  Prediction  Task  efforts  are  projected  to  include  continued 
collection  of  predictor  data  into  1964,  administration  of  the  situational 
criterion  test  exercise  at  the  OEC  through  June  1965,  additional  analysis 
of  predictors  in  both  the  1958-1959  and  the  1961-1962  ratee  samples,  pro¬ 
cessing  of  both  predictor  and.  criterion  data,  organization  of  the  data 
for  analysis,  and  differential  validity  analysis. 


Predictor  Data 

Three  kinds  of  predictor  data  are  expected  to  be  ready  for  differ¬ 
ential  validity  analysis  by  July  1964,  a  probable  first  cut-off  date  for 
situational  criterion  data  collection  at  the  OEC: 

Job-orisntad  DOB  Subscores.  Scores  on  sets  of  DOB  items  were 
identified  in  tbs  155^-1555  ratee  sample  on  the  basis  of  relationship  to 
rated  perfonaa&oe  In  the  hard-core  technical,  administrative,  and  combat 
aubtanqples.  Scoring  formulas,  or  keys,  for  these  groups  of  Items  will  be 
validated  first  against  ratee  criterion  data  obtained  on  technical,  ad¬ 
ministrative,  and  oceibat  officers  in  the  1961-1962  sample,  and  finally 
[  against  the  situational  performance  criteria  in  the  OEC  Job  area  sub- 

samples, 

t 

The  Subject-Matter  Item  Clusters.  Clusters  of  items  in  the  self- 
description  and  information ' ( interest )  instruments  are  being  delineated 
by  subject-matter  on  a  Judgmental  basis.  These  clusters  will  then  be 
refined  empirically  by  internal  analysis  using  cases  in  the  1961-1962 
sample.  This  phase  will  involve  identification  of  suitable  samples  for 


-  44  - 


analysis,  and  the  iteration  of  iten-subscore  correlation  analysis  for 
empirical  refinement  w  the  item  dusters.  Scores  on  the  refined  keys 
will  then  be  obtained  for  all  DOB  examinees.  (Data  are  available  for 
hypothesizing  the  most  valid  clusters  for  the  various  job  areas,  baaed 
on  results  in  the  1958-1952  ratee  sample.  Thus  unbiased  validity  es¬ 
timates  for  these  clusters  can  be  obtained  in  the  ljCl-TOuf  r  ample. ) 
Empirically  defined  predictors  which  are  psychologically  meaningful  are 
desirable  for  use  by  students  and  incoming  officers  for  self -analysis 
and  for  counselling,  as  veil  as  for  operational  guidance  in  branch  and 
duty  assignment. 

Operational  Data.  One  element  in  the  evaluation  of  the  experimental 
predictors  will  be  the  possible  improvement  tney  offer  over  measures 
currently  used  in  the  various  selection  programs  through  which  the  Amy 
procures  its  officers.  For  tvo-year  reservists,  operational  data  used  in 
selection  and  branch  assignment  include  score  on  the  ROTO  qualifying 
Examination,  college  major,  college  grade-point  average,  and  stated  pre¬ 
ference  for  branch  assignment.  Available  data  of  a  comparable  nature 
will  be  processed  for  Regular  Arrv  officers  entering  service  as  ROTC 
Distinguished  Military  Graduates  er  as  'J.  G.  Military  Academy  graduates. 


Preliminary  Analytic  of  Criterion  Do:o 

Job  descriptions  and  Job  performance  ratings  are  obtained  on  all 
officers  in  the  examinee  samples.  The  ratings  provide  one  criterion  on 
all  predictor  examinees.  On  the  basis  3f  job  descriptions,  homogeneous 
subsamples  will  be  established  corresponding  to  those  analyzed  in  the 
1958-1959  sample.  Criterion  rating  scores  computed  on  these  officers 
will  penult  validation  of  Job-oriented  scoring  keys  established  in  the 
earlier  sample.  Within  any  sub sample,  those  officers  selected  for  OEC 
criterion  testing  will  constitute  a  special  subsample  for  comparison  of 
rating  and  situational  criterion. 

Situational  perfomafloe  test  data  from  the  15  tests  of  the  DOPE 
will  be  subjected  to  oonrelatlonal  analysis  to  evaluate  the  internal  con¬ 
sistency  of  the  15  problems  and  of  scores  in  tbs  three  brood  areas— 
technical,  administrative,  end  combat.  These  data  will  be  examined  sepa¬ 
rately  in  each  of  the  three  >30 -officer  saaples  in  order  to  determine  the 
effect  of  type  of  Any  duties  on  level  and  correlational  behavior  of 
scores.  The  outcome  will  guide  considerations  of  whether  subsequent 
validity  analysis  must  be  conducted  separately  in  each  of  the  three  sam¬ 
ple#  or  can  bo  baaed  on  the  aotfblned  900-off ioer  sample  with  three  main 
criterion  aeons  for  each  case. 

Similar  analysis  by  Job -area  sample  will  also  be  conducted  on  the 
auxiliary  criterion  data  reflecting  branch  and  Job  satisfaction  and 
career  intention  of  the  OEC  examinee.  In  addition,  the  actual  retention 
criterion  will  become  available  for  these  examinee*  as  their  terms  of 
obligated  service  expire. 
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Validity  Analytii 


The  primary  focus  viH  be  on  the  tests  of  the  minimum  hypothesis  in 
the  OKC  cample.  Each  of  the  900  situational  criterion  cases  will  have 
tliree  performance  scores  reflecting  technical,  administrative,  and  combat 
performance.  If  the  technical  predictor  is  more  valid  for  technical  per¬ 
formance  than  are  the  administrative  and  combat  predictors  and  if  it  is 
rare  valid  for  technical  performance  than  it  is  for  administrative  and 
combat  performance— and  if  similar  results  are  attained  with  the  other  two 
predictors— then  the  minimum  liypothesis  is  upheld  and  abilities  to  meet 
the  differing  psychological  requirements  of  the  three  kinds  of  officer 
jobs  arc  differentially  predictable. 

Also  in  the  DEC  sample,  the  validity  of  the  predictors  will  be 
examined  against  the  auxiliary  criterion  measures  of  branch  and  job 
satisfaction  and  strength  of  cai ler  intention  to  determine  vheuher  means 
exist  for  placing  newly  commissioned  officers  in  branch  find  job  assign¬ 
ments  which  will  w:J.ancc  tn'ir  feelings  of  satisfaction  and  their  dis¬ 
position  tc  become  career  officers.  Finally,  the  interrelationships 
among  the  a*  o;i*lL  criterion  scores,  the  auxiliary  criteria,  and  the 
Job  perfon.Juice  ratiiig  will  be  examined. 

In  the  larger  group  having  the  rating  criterion,  the  tliree  types  of 
predictor  (job-oriented  DOB  subscorcs,  subject-matter  DOB  subscores,  and 
operational  data)  vill  bo  validated  by  similar  differential  analysis. 

For  this  study  the  sample  vill  be  broken  down  into  eight  subgroups 
matching  those  analyzed  in  the  195^-1959  examinee  sample.  Since  these 
subsampleo  represent  a  more  refined  breakout  of  officer  jobs  than  do  the 
tliree  broad  areas  of  technical,  administrative,  and  combat  jobs,  a 
favorable  outocoe  in  these  groups  could  permit  the  selection  of  predic¬ 
tor  content  for  operational  use  over  a  fairly  vide  range  of  officer  Job 
types. 
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